Skip to main content
Glama

Evaluate a protocol upgrade

evaluate_protocol_upgrade
Idempotent

Run the bounded fixed-suite evaluation for an accessible declarative response-contract proposal and record its receipt; it does not execute arbitrary code/prompts or deploy. Requires authenticated access and proposal/baseline/candidate identifiers. Use propose_protocol_upgrade first. Unsupported candidates, version mismatches or unavailable suite evidence do not pass; retain the returned inconclusive/blocked status.

Input Schema

NameRequiredDescriptionDefault
proposal_idYesRequired accessible proposal ID previously returned by propose_protocol_upgrade.
suite_versionNoOptional fixed evaluation suite version; defaults to cassie-contract-1, and unsupported versions are inconclusive.cassie-contract-1
idempotency_keyYesRequired stable key, 8–160 characters, for retry-safe evaluation receipt.
baseline_versionYesRequired baseline version identifier; the evaluator checks it against the active fixed baseline.
candidate_versionYesRequired candidate version/hash identifier; it must match the stored candidate.

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed5 schema fields changed
    • addedInput schema / properties / baseline_version / description
      Added value: +"Required baseline version identifier; the evaluator checks it against the active fixed baseline."
    • addedInput schema / properties / candidate_version / description
      Added value: +"Required candidate version/hash identifier; it must match the stored candidate."
    • addedInput schema / properties / idempotency_key / description
      Added value: +"Required stable key, 8–160 characters, for retry-safe evaluation receipt."
    • addedInput schema / properties / proposal_id / description
      Added value: +"Required accessible proposal ID previously returned by propose_protocol_upgrade."
    • addedInput schema / properties / suite_version / description
      Added value: +"Optional fixed evaluation suite version; defaults to cassie-contract-1, and unsupported versions are inconclusive."
  2. First observed

TDQS

A4.1/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare idempotentHint=true, readOnlyHint=false, destructiveHint=false and openWorldHint=true, so the safety profile is partly covered. The description still adds real context: authenticated access is required, a receipt is recorded, no deployment or arbitrary code execution occurs, and certain inputs produce an inconclusive/blocked status to be retained rather than retried. It does not spell out rate limits or what a passing receipt contains.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The purpose and its explicit non-goals are front-loaded in the first sentence, with prerequisites and failure semantics following. The prose is dense and semicolon-chained, which slightly hurts readability, but no sentence is filler.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For an idempotent, open-world mutation with no output schema, the description covers the essentials: auth requirement, prerequisite tool, non-deployment guarantee, and the meaning of non-passing outcomes returned to the caller. A fuller account of the success receipt's contents is the only notable omission.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so all five parameters are already documented in the schema, including defaults, lengths and the retry-safe idempotency key. The description only restates that proposal/baseline/candidate identifiers are required, adding no format or precedence detail beyond the schema. Baseline 3 applies when the schema carries the parameter burden.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description supplies a specific verb and resource ("run the bounded fixed-suite evaluation for an accessible declarative response-contract proposal and record its receipt") and immediately bounds the scope with explicit negatives ("does not execute arbitrary code/prompts or deploy"). An agent can distinguish this from sibling propose_protocol_upgrade without opening either schema.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

"Use propose_protocol_upgrade first" gives an explicit predecessor and sequencing rule, and the failure conditions ("unsupported candidates, version mismatches or unavailable suite evidence do not pass") tell the agent when the call yields a non-passing result. It stops short of naming alternative evaluation paths or stating full when-not-to-use conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.

Resources