Skip to main content
Glama

Benchmark run details

benchmark_run
Read-onlyIdempotent

One run's full result (code, compile_ok, runtime_ok, stdout_ok, cost, tokens).

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "runId": "<runId>"
    },
    "name": "benchmark_run"
  }
}

Input Schema

NameRequiredDescriptionDefault
runIdYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

C2.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint, idempotentHint, and destructiveHint=false, so the safety profile is covered structurally. The description adds a list of returned fields, which is mild value, but says nothing about missing/unknown runs, errors, or the size of the payload. Beyond annotations, it contributes almost nothing.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single front-loaded sentence with no filler; the parenthetical list of fields is compact and informative. It is appropriately sized for a simple lookup, though a sentence on runId provenance would have been worth the space.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a one-parameter read tool with no output schema, the field enumeration partially substitutes for a return-value description, which is helpful. However, the crucial link between runId and the listing tools is absent, leaving the call sequence incomplete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 0% and the sole parameter runId is a bare string with no explanation. The description never clarifies what a run identifier is or where to obtain it (presumably from benchmarks_list or benchmarks_for_model), so the one parameter that matters is unexplained in both places.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose3/5

Does the description clearly state what the tool does and how it differs from similar tools?

"One run's full result" conveys that this retrieves a single benchmark run, but it never states an explicit verb like "get" or "fetch," and it doesn't distinguish itself from siblings such as benchmarks_list or benchmarks_compare by naming the difference. The parenthetical field list helps paint the picture of a single-run result object.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

There is no stated condition for when to use this instead of benchmarks_list or benchmarks_compare, and no note that it should be used once you have a specific run identifier. The agent must infer from the phrase "one run's" that this is the single-record lookup.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.