Skip to main content
Glama

Get custom benchmark

get_custom_benchmark
Read-only

Get a private custom benchmark's current report: members, current stats (headline median/quartiles only when ≥3 comparable priced members — monthly, per-seat and per-call prices are never blended), buyer-tier / provider-type / pricing-unit cohorts, historical index, and data coverage. Pass benchmark_id (your cb_ token) as an ARGUMENT.

Input Schema

NameRequiredDescriptionDefault
as_ofNoOptional YYYY-MM-DD — reproduce the exact stats + index as they were on that date, using this version's fixed membership
versionNoOptional benchmark version (default latest)
benchmark_idYesYour cb_ token (bearer secret; passed as an argument, never a URL)
response_modeNofull includes the index series

Output Schema

NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed1 schema field changed
    • changedOutput schema / (root)
      Previous value: -nullNew value: +{
      +  "additionalProperties": true,
      +  "description": "JSON result; identical to the text content block.",
      +  "type": "object"
      +}
  2. Added

TDQS

A3.9/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true and openWorldHint=false, so safety is covered. The description goes beyond that with real behavioral constraints: headline medians/quartiles appear only with ≥3 comparable priced members and monthly/per-seat/per-call prices are never blended, which tells the agent what results can look like and why.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The report contents are front-loaded in a single dense sentence, followed by the argument instruction. Efficient overall, though the final sentence largely repeats the benchmark_id guidance already present in the schema.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With an output schema present, return-structure detail is unnecessary and annotations carry the safety profile. The description supplies the one non-obvious caveat (aggregation threshold) and covers the read path adequately for a 4-parameter tool.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so as_of, version, benchmark_id, and response_mode are already documented, including the enum. The description only reinforces that benchmark_id is a cb_ token passed as an argument, adding little beyond the schema; baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource ('Get a private custom benchmark's current report') and enumerates what the report contains: members, stats, cohorts, historical index, coverage. This clearly separates it from the create/update/delete_custom_benchmark siblings and from market-level tools like get_price_index.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Usage is implied — read the report for a custom benchmark you already own — but there is no explicit when-to-use or when-not versus siblings such as price_benchmark, compare_providers, or get_price_index. The only explicit instruction is passing benchmark_id as an argument.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources