Server Quality Checklist

Tool Scores

• get_usageA
  3.5/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It describes what the tool returns (tier, proofs used, proofs remaining, reset date), which is helpful. However, it doesn't mention critical behavioral traits like whether this is a read-only operation, if it requires authentication, or any rate limits. The description adds some value but leaves gaps in behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and well-structured, consisting of two sentences that efficiently convey the tool's purpose and return values. Every sentence adds value without unnecessary details, making it easy to understand at a glance.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given that the tool has 0 parameters, 100% schema coverage, and an output schema exists, the description is reasonably complete. It explains what the tool does and what it returns, which is sufficient for a simple read operation. However, it could be more complete by addressing authentication or usage context, especially since no annotations are provided.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters, and the schema description coverage is 100%, so there's no need for parameter details in the description. The baseline for this scenario is 4, as the description appropriately focuses on the tool's purpose and output without redundant parameter information.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Check your ArkForge API usage and remaining credits for the current period.' It specifies the verb ('check') and resource ('API usage and remaining credits'), making it easy to understand what the tool does. However, it doesn't explicitly distinguish itself from sibling tools like 'certify_call', 'get_proof', or 'verify_proof', which prevents a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention any prerequisites, such as authentication requirements, or compare it to sibling tools. The only implied usage is checking API usage, but there's no explicit context for when this is necessary or appropriate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_proofA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It describes what the tool returns (complete proof bundle with specific components) which is valuable context beyond the input schema. However, it doesn't mention performance characteristics, error conditions, authentication requirements, or rate limits, which would be helpful for a retrieval operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is perfectly structured: a clear purpose statement followed by return value details, then parameter documentation. Every sentence earns its place with zero waste. The information is front-loaded with the core functionality stated first.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has an output schema (which handles return value documentation) and only one parameter, the description provides adequate context. It explains what the tool does, what it returns, and documents the parameter with an example. For a simple retrieval tool, this is reasonably complete, though additional behavioral context would improve it.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has 0% description coverage, so the description must compensate. It provides a clear explanation of the single parameter ('proof_id') including its purpose and an example format ('prf_20260310_143022_a1b2c3'), adding significant meaning beyond the bare schema. The example format helps users understand the expected input pattern.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('Retrieve') and resource ('full cryptographic proof for a given proof ID'), distinguishing it from siblings like 'certify_call' (create), 'get_usage' (usage stats), and 'verify_proof' (validation). The verb+resource combination is precise and unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by specifying 'for a given proof ID', suggesting this tool is for retrieving existing proofs rather than creating or verifying them. However, it doesn't explicitly state when to use this versus alternatives like 'verify_proof' or provide exclusion criteria, leaving some ambiguity about tool selection.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify_proofA
  4.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses that the output is 'human-readable' and summarizes verification details, which adds value beyond the schema. However, it lacks details on permissions, rate limits, or error handling, leaving behavioral gaps for a tool with no annotation coverage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is appropriately sized and front-loaded: the first sentence states the core purpose, followed by usage context and parameter details. Every sentence earns its place with no wasted words, making it efficient and easy to parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity (1 parameter) and the presence of an output schema (which handles return values), the description is mostly complete. It covers purpose, usage, and parameter semantics well. However, with no annotations, it could benefit from more behavioral details like authentication or error scenarios, slightly reducing completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds significant meaning beyond the input schema, which has 0% description coverage. It explains that 'proof_id' is 'The proof identifier' and provides an example format ('e.g. "prf_20260310_143022_a1b2c3"'), clarifying the parameter's purpose and expected syntax, fully compensating for the schema's lack of documentation.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('Get a human-readable summary') and resource ('what a proof certifies'), distinguishing it from sibling tools like 'get_proof' (which likely returns raw data) and 'certify_call' (which creates proofs). The purpose is explicit and differentiated.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context for when to use this tool: 'Useful for explaining to a user or auditor what was independently verified, without reading raw JSON.' This implies it should be used for human consumption rather than programmatic access. However, it does not explicitly state when not to use it or name alternatives like 'get_proof'.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• certify_callA
  4.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It effectively explains key traits: it calls an external API, generates a signed proof by ArkForge (third-party), includes timestamping and anchoring, and returns verification details. However, it lacks information on error handling, rate limits, or authentication needs for the target API, leaving some gaps in behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured and front-loaded with the core purpose, followed by usage guidelines, parameter explanations, and return details. Every sentence adds value—no redundancy or fluff—and it efficiently covers necessary information in a compact format.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (external API calls with proof generation), no annotations, and an output schema present, the description is highly complete. It explains the purpose, usage context, parameters, and return values in detail, compensating for the lack of annotations and leveraging the output schema to avoid over-explaining returns. This suffices for effective agent use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It adds meaningful semantics for all parameters: target is the 'URL of the upstream API', payload is the 'JSON body to send', method specifies 'HTTP method', description is 'Human-readable description', and agent_identity is an 'Identifier for the calling agent'. This clarifies usage beyond basic schema titles, though it doesn't detail format constraints (e.g., URL validation).

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Call an external API and get a cryptographic proof of the transaction.' It specifies the verb ('call'), resource ('external API'), and unique outcome ('cryptographic proof'), distinguishing it from sibling tools like get_proof, get_usage, and verify_proof, which focus on retrieving or verifying proofs rather than creating them.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly states when to use this tool: 'Use this INSTEAD of calling the API directly when you need an auditable, tamper-evident record of what was sent and received.' This provides clear guidance on the alternative (direct API calls) and the specific context (need for proof), helping the agent choose correctly among siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.