Skip to main content
Glama

Report the archived token benchmark

demo_report_benchmark_rows
Read-onlyIdempotent

Retrieve committed token counts for 5, 50, and 255 MCP tool definitions under tiktoken cl100k_base, comparing raw JSON, TOON, SLIM, and Compact formats with percentage saved.

Instructions

Returns this project's committed token measurements for 5, 50 and 255 MCP tool definitions encoded with tiktoken cl100k_base: raw JSON, TOON, SLIM and Compact token counts with each format's percentage saved. ...

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault

No arguments

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
rowsYesOne row per tool-set size, smallest first.
sourceYesWhere the measurements came from.
encodingYesTokenizer behind the figures: tiktoken cl100k_base.
measured_at_build_timeYesTrue: these are archived runs, not live calls.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Addedv0.7.14

TDQS

A3.9/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare readOnlyHint=true, openWorldHint=false, idempotentHint=true, and destructiveHint=false, so the safety profile is fully covered. The description adds useful context about the committed/archived nature and the specific benchmark contents, but does not disclose additional behavioral traits such as data freshness guarantees or caching behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single front-loaded sentence that immediately states the return value and then details the dataset sizes, encoding, and formats. Every clause carries useful content, and there is no filler or redundant restatement of the title or annotations.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a no-parameter, read-only tool with rich annotations and an output schema, the description supplies exactly the domain context an agent needs: what benchmark is reported, which tool-definition counts are covered, which encoding is used, and which formats are compared. The output schema handles return structure, so no further description of return values is required.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The tool has zero parameters, so there is no parameter semantics to explain. With an empty schema and 100% schema description coverage, the baseline score of 4 applies; the description adds no parameter information because none is needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description gives a specific verb ('Returns'), resource ('this project's committed token measurements'), and precise scope: 5, 50, and 255 MCP tool definitions, encoded with tiktoken cl100k_base, across raw JSON, TOON, SLIM, and Compact formats. The word 'committed' and 'archived' distinguishes it from live-estimation siblings like demo_estimate_tokens and demo_compare_formats without needing to name them.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explains what data is returned but gives no when-to-use guidance, no conditions for choosing this tool over alternatives, and no exclusions. Sibling tools like demo_compare_formats and demo_estimate_tokens exist, yet the description does not route the agent between them.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.