Skip to main content
Glama

Get Benchmark Metadata

get_benchmark_metadata
Read-onlyIdempotent

Discover benchmark dimensions, available datasets, regions, and taxonomy versions to identify valid options before querying Lightcast benchmark data.

Instructions

Discover benchmark dimensions, available datasets, regions, and taxonomy versions.

Tool call template

This tool declares no required parameters. Add optional parameters from the input schema as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {},
    "name": "get_benchmark_metadata"
  }
}

Input Schema

NameRequiredDescriptionDefault

No arguments

Output Schema

NameRequiredDescriptionDefault

No arguments

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.4.1

TDQS

A3.7/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, openWorldHint, and destructiveHint=false, so the safety profile is fully structured and needs no restating. The description adds value by naming the categories of content exposed (dimensions, datasets, regions, taxonomy versions). It does not mention any access requirements, rate limits, or whether the catalog is static or updated per release, which is modestly relevant for an open-world discovery call.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence with no filler. The verb comes first and the enumerated content follows, so an agent scanning the first few words gets the meaning immediately.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a zero-parameter discovery tool with a full output schema and complete annotations, the description covers the essentials. The one gap is that it never tells the agent that this metadata is consumed by the benchmark query siblings (get_occupation_benchmark, query_core_lmi), which would complete the workflow picture.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool takes zero parameters, so the 4 baseline applies; there is no parameter meaning the description could add. The description does not waste words restating an empty schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a specific verb ("Discover") and enumerates the resources returned: benchmark dimensions, datasets, regions, and taxonomy versions. It is clear what the tool does. It does not explicitly distinguish itself from metadata siblings like get_classification_metadata or get_core_lmi_metadata, so an agent must infer the benchmark-vs-other-domain split from names alone.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

"Discover" implies this is an exploratory entry point to be called before requesting benchmark data, which is implied usage. However, there is no explicit statement of when to use it versus the other metadata tools, no prerequisites, and no note on whether it should be called first to learn valid dimension/region values.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.