Skip to main content
Glama

Evaluation report check

wever_evaluation-report-check
Read-only

Agent Evaluation: submit one evaluation summary written for a buyer or principal: its title and audience, each headline score with whether its spread, sample size and a baseline sit beside it, the limits with whether they are stated, where they sit (beside the headline, a later section, an appendix or a separate document) and what they are, the failures with whether they are reported, how many tasks failed against how many are reported, whether examples are shown and where they sit, which run conditions are stated (model, dataset, run date, scoring method and settings), and whether the full results are linked, on request or not available. The signed report says whether the limits, failures and run conditions are disclosed alongside the headline scores, and names limits never stated, failures left out or reported in part and no model, dataset or run date stated, then limits or failures placed in an appendix or a separate document, limits not named, headline scores without spread, sample size or baseline, every missing run condition, no failure examples and full results not available, with the fix for each. This reads what an evaluation summary discloses beside its headline: whether AI involvement in content is disclosed is wever_ai-disclosure-check, whether a recommendation discloses its interests is wever_recommendation-disclosure-check and whether a benchmark claim’s figures appear in its cited source is wever_benchmark-evidence-check. Verdict headline_only, disclosure_gaps, disclosure_unverified or fully_disclosed. POST /api/evaluation-report-check. Reads only the material in the call: no network request, fetch, money movement, message, sharing, configuration change or external write. Paid URL: 0.10 USDC per call on Base via x402 exact, with the shared 10 signed-wallet free calls per rolling 30 days. Bind X-Wever-Wallet-Proof to the exact JSON arguments and the tool route. Returns a report with an Ed25519 signed receipt. Contract: /api/agent-evaluation-contract. Human page: https://weverlabs.com/agent-evaluation/.

Tool call template

Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {
      "headline": "<headline>"
    },
    "name": "wever_evaluation-report-check"
  }
}

Input Schema

NameRequiredDescriptionDefault
labelNoOptional name recorded in the report.
limitsNo
reportNo
failuresNo
headlineYesEach headline score.
conditionsNo
full_resultsNoLinked, on request, or not available.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Added

TDQS

A4.2/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Beyond the annotations it adds material the agent could not otherwise know: a strict no-side-effect boundary ('no network request, fetch, money movement, message, sharing, configuration change or external write'), pricing and the free-call allowance, the required X-Wever-Wallet-Proof binding to the exact JSON arguments and route, and the fact that a signed Ed25519 receipt is returned. It also enumerates the four verdict values (headline_only, disclosure_gaps, disclosure_unverified, fully_disclosed), which is genuine behavioral disclosure. This is well past what readOnlyHint/openWorldHint/destructiveHint convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The core is one long run-on sentence that enumerates the same field set twice — once as what is submitted, once as what the signed report names — which makes it slow to parse and partially redundant. The second enumeration earns some of its space because it describes the returned findings and per-item fixes in the absence of an output schema. Front-loading is acceptable, but the structure is a wall of clauses rather than scannable segments.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With seven parameters, nested objects, no output schema and only 43% schema coverage, the description still covers input intent, paid/auth mechanics, verdict vocabulary, and what the returned report contains. It also points to the contract endpoint and human page for deeper specification. Nothing an agent needs in order to call this correctly is conspicuously absent.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

At 43% schema description coverage the description has to carry weight, and it does: it explains that headline entries need spread/sample-size/baseline flags shown beside each score, that limits need disclosure state, placement and content, that failures need reported-vs-known counts plus examples and placement, and it spells out the run conditions (model, dataset, run date, scoring method, settings) and the full_results tri-state. The enum meanings are restated in prose ('beside the headline, a later section, an appendix or a separate document'). Only the top-level 'label' parameter goes unmentioned, so it lands just below the top band.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The opening clause names the action and the artifact — 'submit one evaluation summary' — and then enumerates exactly what is examined: headline scores with spread/sample size/baseline, limits with placement, failures with counts and examples, run conditions, and full-results availability. It also names three adjacent checks (wever_ai-disclosure-check, wever_recommendation-disclosure-check, wever_benchmark-evidence-check) and their distinct scopes, so an agent can separate this from disclosure-adjacent siblings. The density of the enumeration makes the core purpose harder to extract than it should be, keeping it out of the top band.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The phrase 'one evaluation summary written for a buyer or principal' sets the input context, and the sentence starting 'This reads what an evaluation summary discloses beside its headline:' routes three related-but-different questions to named sibling tools. That is real alternative routing rather than implied usage. It stops short of stating when-not-to-use versus the closest siblings (wever_evaluation-result-check, wever_evaluation-reproducibility-check), so a 5 is not warranted.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources