Server Quality Checklist

Tool Scores

• guard_checkB
  3.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden, and it does disclose an important non-obvious trait: the result is advisory unless the host wires it into enforcement. The wording 'Evaluate' also implies analysis rather than execution, giving the agent a reasonable safety picture, though side effects and return behavior are not explicitly addressed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two short, front-loaded sentences with no filler: the first states the purpose, the second states a critical caveat about enforcement. Every sentence earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no output schema, no annotations, and zero parameter documentation, the description is too thin. It leaves the return value undefined, does not clarify the semantics of path/command/action, and does not say what a typical verdict looks like. An agent would likely need additional probing to call it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description adds no meaning for `path`, `action`, or `command`. The enum in the schema hints at action types, but the description does not explain how the parameters relate to the evaluation, what values mean, or when each is relevant, so it fails to compensate for the schema's lack of descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Evaluate') and a clear object ('a proposed coding-agent action'), which makes the tool's basic function understandable. It does not explicitly contrast with the sibling guard_status, but 'Evaluate a proposed action' versus 'status' is a strong enough distinction for an agent to pick the right tool.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool is meant to be used when there is a proposed coding-agent action to assess, but it does not explicitly say when to use guard_check vs guard_status or when not to use it. The advisory/enforcement caveat gives useful context about reliance, but there is no routing guidance or exclusion criteria.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• guard_statusA
  3.5/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description bears the full burden. The verb 'Report' implies a read-only, informational operation, which is a useful behavioral signal, but the description does not explicitly state side-effect freedom, authentication needs, or any operational constraints.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence with no filler. It communicates the core purpose in nine words, and every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter, no-output-schema tool, the description adequately states what the tool reports ('guard capabilities' and 'enforcement boundary'). It is minimal but sufficient for invocation, though some domain-specific meaning of 'enforcement boundary' is left implicit.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the input schema is fully complete. Per the baseline for zero-parameter tools, the description need not add parameter-level detail.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Report') and identifies a clear resource ('guard capabilities and the enforcement boundary'). It is not a tautology and gives the agent a concrete sense of what the tool does, though it does not explicitly contrast with the sibling 'guard_check'.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus its sibling 'guard_check'. There is no mention of preferred scenarios, exclusions, or alternative routing, leaving the agent to infer usage from the name alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.