Server Quality Checklist

Tool Scores

• create_trust_anchorC
  2.4/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must carry the full burden of behavioral disclosure. It only states 'create' with no details on side effects, idempotency, permissions required, or what happens on duplicate entity_id. For a mutation tool, this is insufficient.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence, which is appropriately concise, but it sacrifices informativeness. It could incorporate key parameter details without becoming verbose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (5 parameters, nested objects, no output schema), the description is incomplete. It fails to explain what a trust anchor is, how parameters interact, or what the return value is, leaving the agent without critical context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description does not mention any of the 5 parameters (entity_id, entity_name, trust_level, metadata, api_key). The agent gets no help understanding the meaning, defaults, or constraints of these parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('create') and the resource ('trust anchor'), adding domain context ('root of trust for an entity'). However, it does not differentiate from sibling tools like add_attestation, which might also create related entities.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives (e.g., revoke_trust, verify_chain). There is no mention of prerequisites, scenarios, or when not to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• revoke_trustC
  2.4/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must disclose all behavioral traits. It mentions 'invalidates the chain,' hinting at a destructive action, but omits details like required permissions, reversibility, rate limits, or side effects. The disclosure is minimal.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with no unnecessary wording, but it is too short to be informative. While concise, it sacrifices essential details, making it minimally acceptable.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness1/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 4 parameters (3 required), no output schema, and no annotations, the description is severely incomplete. It fails to explain key concepts (trust anchor, attestation, chain), the revocation process, or how parameters relate to each other, leaving the agent ill-equipped to use the tool correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description does not explain any of the four parameters (target_id, reason, revoked_by, api_key). The parameter names alone are unclear (e.g., 'target_id' could refer to an anchor or attestation), so the agent gets no assistance in filling them correctly.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states 'Revoke a trust anchor or attestation' and indicates the effect 'invalidates the chain.' The verb and resource are clear, but it does not differentiate from sibling tools like add_attestation or create_trust_anchor, which may also involve trust operations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives (e.g., get_trust_score, verify_chain). There are no preconditions, warnings, or exclusions mentioned, leaving the agent without context for appropriate invocation.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• add_attestationC
  2.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description indicates a mutation (add), but provides no further behavioral details. With no annotations present, the description should disclose side effects, permissions, idempotency, or error conditions. It lacks context such as whether the attestation overwrites duplicates, whether the anchor is modified, or any auth requirements.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence that front-loads the core action. It is not overly verbose, but it sacrifices informativeness for brevity. A slightly longer description with parameter hints would be more useful while still being concise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness1/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has 6 parameters with no schema descriptions, no annotations, and no output schema, the description is severely incomplete. It does not explain parameter usage, return value, or behavior beyond the basic action. The agent cannot infer correct usage from this alone.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 0% description coverage, and the tool description adds no meaning to the parameters. Parameters like confidence, evidence, and api_key remain unexplained. The description fails to compensate for the missing schema descriptions, leaving the agent guessing their purpose and format.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action: add an attestation (claim) to an existing trust anchor. It uses a specific verb and resource, distinguishing it from sibling tools like create_trust_anchor which creates a new anchor, and revoke_trust which revokes trust.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. There is no mention of prerequisites (e.g., anchor must exist) or when not to use it. The description implies the anchor must exist but does not state this explicitly or suggest checking with other tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify_chainC
  2.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must disclose behavioral traits. It states it validates attestations, but does not reveal whether the tool is read-only, what happens on invalid chains, or any side effects. Minimal transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence, which is concise. However, it is under-specified; conciseness should not come at the expense of useful content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given low complexity (2 parameters, no output schema), the description should cover return value and parameter roles. It fails to do so, leaving the agent with insufficient information.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, yet the description provides no information about the parameters (anchor_id, api_key). The agent gets no help understanding what these mean or how to use them.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Verify the integrity of a trust chain by validating all attestations.' It uses a specific verb and resource, and distinguishes from sibling tools like add_attestation or revoke_trust, which have different purposes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance on when to use this tool versus its siblings. It does not mention prerequisites, contexts where verification is appropriate, or when not to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_trust_scoreC
  2.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must disclose behavioral traits. It only states that the tool calculates a score, without mentioning whether it is read-only, authorization needs (api_key is optional but not explained), or any side effects.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with no waste. However, it is extremely minimal and could benefit from more structure, such as separating purpose from usage notes.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the lack of annotations, an output schema, and the presence of sibling tools, the description is incomplete. It does not explain what the trust score output looks like, nor any preconditions or behavior beyond the basic calculation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description adds no meaning beyond the schema. It does not explain the role of 'anchor_id' or 'api_key', leaving the agent without guidance on how to supply parameters correctly.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Calculate' and clearly identifies the resource 'composite trust score for an anchor based on its attestations.' This distinguishes it from sibling tools like add_attestation, create_trust_anchor, revoke_trust, and verify_chain, which have different purposes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is given on when to use this tool versus alternatives. There is no mention of prerequisites, when-not to use, or context that helps an agent decide between this and siblings like verify_chain.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.