Skip to main content
Glama

benchmark_trust_verdict

TensorFeed's signed ruling on whether an AI benchmark is still a trustworthy capability signal or saturated, contaminated, or near ceiling so a high score should be down-weighted: a trust band (reliable, use_with_caution, saturated, contaminated, deprecated) and a 0-100 trust score per benchmark. Pass benchmark to narrow to one, or category to filter, or neither for the registry. tier='preview' is free (10 calls per day per IP), top verdict and bands only. tier='full' costs 1 credit ($0.02) and adds the per-signal detail (ceiling proximity, frontier compression, contamination), a down-weight recommendation with an alternative benchmark, and an AFTA-signed receipt. Omit tier and you get the free preview, unless the call carries a payment or credits token (or uses the strict x402 transport), in which case it bills as full. Pay per call with an x402 wallet payment (arguments.payment, or an X-PAYMENT header; strict HTTP-402 transport at https://mcp.tensorfeed.ai/mcp?x402=strict) or use an Authorization: Bearer tf_live_... credits token. No token and no USDC? Claim free trial credits by signing a wallet message at https://tensorfeed.ai/api/payment/trial-credits.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
tierNo'preview' (free, 10 calls per IP per day) or 'full' (1 credit; adds per-signal detail, recommendation, signed receipt). Omitted: preview, unless a payment or credits token is attached.
paymentNoOptional base64 x402 payment payload (the same string an X-PAYMENT header would carry). Sign against the accepts[0] requirement returned by an unpaid call. Alternative to the Bearer credits token.
categoryNoCategory to filter the benchmarks (e.g. "coding", "reasoning"). Optional.
benchmarkNoBenchmark registry id or name to narrow to one (e.g. "mmlu", "swe-bench"). Optional.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the full burden and does so well: it discloses rate limits (10 free calls/day per IP), pricing (1 credit / $0.02), the billing rule when tier is omitted, and the two auth paths (x402 payment vs Bearer credits token). It does not explicitly state the operation is read-only or side-effect free, which is the only notable gap.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The purpose and output are front-loaded, but the final two sentences on payment mechanics are long and partly restate the tier schema description, adding density without new information. A complex tool justifies some length, but this could be tightened.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

There is no output schema, so the description must describe returns, and it does: trust band values, 0-100 trust score, and the extra per-signal detail, recommendation, and signed receipt in the full tier. For a payment-gated tool this is largely complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is already 100%, so baseline is 3, but the description adds real meaning beyond the schema by explaining the conditional default for tier (preview unless a payment or credits token is attached) and how payment and benchmark/category interact with the request.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

States a specific verb and resource: a signed ruling on whether an AI benchmark is a trustworthy capability signal, returning a trust band and 0-100 trust score. This clearly separates it from siblings like benchmark_series or compare_models, which measure rather than judge.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Explicitly tells the agent how to scope the call (benchmark to narrow, category to filter, neither for the registry) and how tier selection drives cost and output. It stops short of naming sibling alternatives or stating when NOT to use this tool versus benchmark_series.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.