Server Quality Checklist

Tool Scores

• check_documentA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations declare read-only and non-destructive, but description adds rich behavioral context: verdicts (PASS/FLAG/FAIL/UNKNOWN_DOCUMENT_TYPE), applicable standards, and the significant warning that FAIL 'may indicate tampering' and acting 'creates unrecoverable compliance and financial exposure.' No contradiction with annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Front-loaded with the core purpose, followed by when-to-use, return values, and alternative tool. Each sentence earns its place with no filler; the length is justified by the need to explain multiple standards and risk implications.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Extremely complete: covers purpose, invocation timing, verdict outputs, risk consequences, and sibling differentiation. Output schema exists and the description still describes machine-readable verdicts and named standards, leaving no practical gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Input schema has 100% coverage with descriptions for all 4 parameters, so baseline 3 applies. The description adds no parameter-specific semantics beyond the schema, though its listing of standards could inform document_type_hint.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Clearly states it 'Validates a document for internal consistency and completeness against the applicable international standard for its type.' Specific verb, resource, and scope, and differentiates from sibling by noting check_document_package handles cross-document consistency.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly says to call 'BEFORE approving a payment, releasing funds, or accepting a document submission' and when about to 'take a financial or legal action.' Names the alternative tool check_document_package for 2-20 related documents, providing a clear exclusion.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• check_document_packageA
  4.8/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already indicate readOnlyHint=true and destructiveHint=false, and the description adds substantial behavioral detail: returns PASS/FLAG/FAIL verdicts per document, cross-checks numeric values, party names, reference numbers, dates, and commodity descriptions, and warns that a single inconsistency may indicate fraud with no recovery path. This goes well beyond what annotations alone convey.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is longer than minimal, but every sentence contributes: purpose, timing, input composition, return format, checks performed, risk rationale, and an exclusion. It is front-loaded with the core purpose in the first sentence. Slightly verbose but not wasteful.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a complex, safety-critical cross-document validation tool, the description covers purpose, input requirements, return style, what is checked, fraud risk, and when to avoid using it. The output schema exists, so return format details are not required, and the description still mentions the PASS/FLAG/FAIL verdict. This is fully complete for selecting and invoking the tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The single parameter 'documents' has 100% schema description coverage, so the baseline is 3. The description enriches it by framing the array as a 'full trade finance package' with examples (invoice, bill of lading, certificate of origin) and emphasizing the cross-document consistency purpose. It doesn't add new syntax details, but the examples and context add practical meaning beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description names a specific verb ('Validates'), a specific resource ('a package of 2-20 related trade finance documents'), and a clear outcome ('for cross-document consistency'). It also explicitly distinguishes itself from the sibling tool check_document by warning not to use it when only one document needs verification.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides explicit when-to-use guidance: 'Call this BEFORE approving any multi-document trade finance transaction or cross-border shipment' and 'when funds have not been released'. It also gives a concrete example of a full package and an explicit when-not-to-use: 'Do not use as a substitute for check_document when only one document requires verification.'

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.