Skip to main content
Glama

Get vendor benchmark

get_benchmark
Read-onlyIdempotent

Per-vendor benchmark card by slug within any theme: full provenanced record plus dataset-derived indicators (entry price, normalized cost at 100 and 500 calls/mo where call-volume applies, billing models, free-tier presence, compliance, integration breadth). Set section to the theme slug from list_sections. All values trace to plan sources; no synthetic scores.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
slugYes
sectionNoTheme slug to query (default "ai-receptionists"). A theme is any of the 275 pricing topics this index covers: the deep hub sections (e.g. ai-receptionists) plus the many catalog topics (e.g. vpn-services, web-hosting, password-managers). Call list_sections or list_coverage for the full slug list — do not assume the old four-section set.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedInput schema / properties / section / description
      Previous value: -"Theme slug to query (default \"ai-receptionists\"). A theme is any of the 273 pricing topics this index covers: the deep hub sections (e.g. ai-receptionists) plus the many catalog topics (e.g. vpn-services, web-hosting, password-managers). Call list_sections or list_coverage for the full slug list — do not assume the old four-section set."New value: +"Theme slug to query (default \"ai-receptionists\"). A theme is any of the 275 pricing topics this index covers: the deep hub sections (e.g. ai-receptionists) plus the many catalog topics (e.g. vpn-services, web-hosting, password-managers). Call list_sections or list_coverage for the full slug list — do not assume the old four-section set."
  2. Changed1 schema field changed
    • changedInput schema / properties / section / description
      Previous value: -"Theme slug to query (default \"ai-receptionists\"). A theme is any of the 271 pricing topics this index covers: the deep hub sections (e.g. ai-receptionists) plus the many catalog topics (e.g. vpn-services, web-hosting, password-managers). Call list_sections or list_coverage for the full slug list — do not assume the old four-section set."New value: +"Theme slug to query (default \"ai-receptionists\"). A theme is any of the 273 pricing topics this index covers: the deep hub sections (e.g. ai-receptionists) plus the many catalog topics (e.g. vpn-services, web-hosting, password-managers). Call list_sections or list_coverage for the full slug list — do not assume the old four-section set."
  3. First observed

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already mark this readOnly=true and openWorld=true, so the safety profile is covered. The description adds meaningful behavioral context beyond annotations: every value is 'provenanced,' computed indicator values are derived from plan data, and there are 'no synthetic scores' — this tells the agent how much to trust the data and what kind of output to expect.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences with no filler: purpose and content in the first, derivation guarantee and usage pointer in the second. It front-loads the core definition and packs useful caveats ('where call-volume applies', 'no synthetic scores') without redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a read-only record-fetching tool, the description covers what data is returned, where the `section` slug comes from, and the provenance/no-synthetic guarantee. It does not mention failure behavior for unknown slugs or output formatting, but given no output schema and read-only annotations, the key operational context is present.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 50%: `section` has a rich description and the tool description reinforces its source (list_sections). However, `slug` has no schema description and the description only indirectly implies it is the vendor slug; it does not explain the format or how to discover valid slug values. Baseline for partially covered params is 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description names a specific resource ('Per-vendor benchmark card by slug') and a specific theme scope ('within any theme'), then lists exactly what the card contains: provenanced record, entry price, normalized costs at 100/500 calls, billing model, free tier, and integration breadth. This clearly distinguishes it from generic search tools like search_vendors. The 'no synthetic scores' statement further sharpens the purpose.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It explicitly instructs the agent to set `section` to a theme slug from list_sections, which is actionable usage guidance. It does not explicitly name sibling tools as alternatives or give when-to-use vs when-not-to-use criteria, but the scoping instruction and 'do not assume the slug' warning provide clear context.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.