Server Quality Checklist

Tool Scores

• get_screenshotA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It only restates the basic function ('Get the screenshot image') and does not mention return format, error behavior, or any side effects. For a tool that retrieves a resource, more detail is needed (e.g., whether it returns binary data or a URL, what happens if the ID is invalid).

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, clear sentence that is front-loaded with the action and resource. It contains no redundant words and is appropriately concise for the tool's simplicity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple (one parameter, no output schema, no annotations), so the description is mostly adequate. However, since there is no output schema, the description should clarify what 'screenshot image' means as a return value (e.g., binary, path, URL). This missing detail prevents a higher score.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100% – the schema already explains the 'id' parameter as 'The annotation ID'. The description adds no additional meaning beyond this, so the baseline of 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action ('Get the screenshot image'), the target resource ('for a specific annotation'), and the scope ('by ID'). This distinguishes it from sibling tools like get_all_pending (which lists pending items) and resolve (which likely acts on annotations).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when you have an annotation ID and need its screenshot, but it does not explicitly state when to use this tool versus alternatives or provide any exclusions. No mention of when not to use or prerequisites beyond the ID is given.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• resolveA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It transparently discloses a key side effect: 'This removes the marker from the browser on next page load.' This goes beyond a generic mutation statement by specifying both the removal and the timing, though it does not address edge cases like invalid IDs or idempotency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description consists of two concise sentences that are front-loaded with the primary action and add a valuable detail about the side effect. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter mutation tool with no output schema, the description provides sufficient context: the action and the timing of the visible effect. While it doesn't describe return values or error handling, the simplicity of the tool makes this acceptable.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100% with the parameter 'id' described as 'The annotation ID to resolve.' The tool description adds no additional meaning beyond this, so the baseline of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action: 'Mark an annotation as resolved.' This is a specific verb+resource construction that distinguishes it from siblings (get_all_pending, get_screenshot) by focusing on resolution rather than listing or capturing.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context for the tool's purpose via the verb 'resolve' and the sibling tool names, but it does not explicitly mention when to use it over alternatives or when not to use it. This matches a 'clear context, no exclusions' score.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_all_pendingA
  4.6/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Without annotations, the description carries the full burden and discloses key behaviors: it returns metadata fields (comment, element, URL, severity), excludes screenshots, and focuses on unresolved annotations. While it doesn't cover every conceivable detail like pagination or permissions, it gives a clear behavioral contract for a simple read-only operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences long, front-loaded with the core purpose and immediately followed by return-value details and an exclusion with an alternative. Every word earns its place, with no redundancy or irrelevant information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple parameterless tool with no output schema, the description is quite complete, listing the returned metadata fields and explicitly noting the absence of screenshot data. It could theoretically add details like sorting or global scope, but for a straightforward listing action, it covers the essential information needed by an agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, and the input schema is empty, so there is no parameter detail to explain. Per the baseline for 0-parameter tools, a score of 4 is appropriate; the description adds no parametric information, but none is required.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool retrieves all pending (unresolved) annotations from the UI, using a specific verb and resource. It also distinguishes itself from the sibling tool get_screenshot by explicitly noting it excludes screenshot data, making its unique purpose obvious.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit guidance on when to use this tool (when needing annotation metadata) and when not to (when needing screenshots), naming the alternative get_screenshot. This covers the primary use case decision and sets expectations for users.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.