Server Quality Checklist

Tool Scores

• verify_contractB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It mentions the signed code hash output but does not state whether the operation is read-only, error behavior for non-contracts, chain support, or any side effects. This is insufficient.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is one concise sentence that front-loads the core purpose and adds a necessary detail about the signed hash. There is no redundancy or fluff.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has two parameters, no output schema, and no annotations. The description covers the core function but omits the chain parameter, expected return format beyond a signed hash, and any caveats. It is not complete enough for the agent to use correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 50% (only address is described). The tool description does not clarify the chain parameter or the default value, and it does not compensate for the missing schema description. The description adds no parameter meaning beyond what is already in the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool verifies whether an address is a smart contract and retrieves its code hash with an ECDSA signature. This is a specific verb+resource and distinguishes from sibling tools verify_signature and verify_balance.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage through its name and sibling context, but it does not explicitly state when to use this tool versus alternatives, nor does it provide any exclusions. The guidance is only implicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify_signatureA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description bears full responsibility for disclosing behavioral traits. It merely states the core verification function but does not disclose potential side effects, error behavior, return format, or safety profile (e.g., whether it is read-only). This is a significant gap for a tool that verifies authenticity.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two concise sentences, front-loaded with the main action. Every word earns its place without redundancy or unnecessary detail. It is optimally brief and clear.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with full schema coverage, but there is no output schema. The description does not explain what the tool returns or what happens on success/failure, which is a gap given the absence of an output schema. It also doesn't mention prerequisites in the description itself. Overall, it is minimally complete but lacks important result-related context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% coverage for both parameters, with clear descriptions for 'response' and 'expectedSigner'. The tool description does not add any additional meaning beyond what the schema provides, so the baseline of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states a specific action ('Verify a zkVerify ECDSA signature') and the target resource ('on a previous response'). It also adds the purpose of the verification ('Checks signer authenticity'). This distinguishes it from sibling tools like verify_contract and verify_balance, which likely perform different verification tasks.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context: it is used on a previous response, which indicates a prerequisite. However, it does not explicitly mention when to use this tool versus alternatives, nor does it state any exclusions or when not to use it. The context signal that parameters come from verify_balance or verify_contract is only in the schema, not the description.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify_balanceA
  3.6/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of behavioral disclosure. It adds useful context by mentioning Merkle proof and ECDSA signature, and states that it returns 'cryptographically verified balance data.' However, it does not disclose whether the operation is read-only, any error conditions, or side effects, leaving some ambiguity.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise, two sentences, and front-loaded with the primary action. Every word earns its place: the first sentence states what it does, the second clarifies the return type. No wasted text.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (2 parameters, no output schema, no annotations), the description is mostly complete but leaves gaps. It does not mention the chain parameter, default behavior, or any edge cases. The claim of returning 'verified balance data' is helpful but lacks specifics about response structure or error handling.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema covers 50% of parameters (address has a description, chain does not). The description does not compensate for the chain parameter's lack of meaning, nor does it explain the address format beyond what the schema already provides. It mentions 'balance' but not the parameters explicitly, adding minimal value beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Verify any blockchain address balance with Merkle proof and ECDSA signature.' It names a specific verb (verify), a clear resource (blockchain address balance), and adds cryptographic details (Merkle proof, ECDSA signature) that differentiate it from siblings like verify_contract or verify_signature.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use the tool ('Verify any blockchain address balance') but provides no explicit guidance on when not to use it or how it compares to sibling tools. There is no mention of alternatives, prerequisites, or exclusions, so the guidance is only implicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.