Server Quality Checklist

Tool Scores

• designer_closeA
  3.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It mentions 'release resources', which hints at cleanup behavior, but does not disclose critical details like whether this is destructive (e.g., closes without saving), requires specific permissions, or has side effects. For a tool with no annotations, this leaves significant behavioral gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's purpose with no wasted words. It is appropriately sized and front-loaded, making it easy to understand immediately without unnecessary elaboration.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (0 parameters, no output schema, no annotations), the description is adequate but incomplete. It covers the basic action but lacks details on behavioral aspects like what happens to unsaved work or error conditions. For a tool that likely interacts with a browser, more context would be helpful despite the low complexity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters with 100% schema description coverage, so the schema fully documents the lack of inputs. The description does not add parameter details, which is unnecessary here. Baseline is 4 for 0 parameters, as no additional parameter semantics are needed beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('Close') and resource ('the designer browser'), distinguishing it from sibling tools like designer_open (open), designer_pick (pick), and designer_screenshot (capture screenshot). It provides a complete verb+resource combination that is unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when the designer browser is open and resources need releasing, but it does not explicitly state when to use this tool versus alternatives or any prerequisites. It lacks explicit guidance on when-not-to-use or named alternatives, leaving usage context somewhat implied rather than clearly defined.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• designer_openA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses key behavioral traits: it opens a URL, launches Chromium if not running, and is intended as a preparatory step. However, it lacks details on error handling, timeouts, or what happens if the URL is invalid, which are important for a tool that interacts with a browser.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise and front-loaded, with two sentences that efficiently convey the action, conditional behavior, and usage context. Every sentence earns its place by providing essential information without redundancy or fluff.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity (1 parameter, no output schema, no annotations), the description is mostly complete. It covers purpose, usage, and key behavior. However, it could improve by mentioning potential side effects (e.g., browser window focus) or error scenarios, slightly reducing completeness for a tool that launches external processes.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, with the schema fully documenting the 'url' parameter. The description does not add any meaning beyond the schema (e.g., URL format examples or constraints), so it meets the baseline of 3 where the schema does the heavy lifting without extra value from the description.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('Open a URL') and the target resource ('in the designer's headed Chromium'), including the conditional behavior ('launches it if not running'). It distinguishes from siblings by mentioning designer_pick as a subsequent step, showing awareness of the tool's role in the workflow.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It explicitly provides when-to-use guidance by stating 'Use this before designer_pick,' establishing a clear sequence in the workflow. This directly addresses when to use this tool versus alternatives (like designer_screenshot or designer_close) by positioning it as a prerequisite step.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• designer_screenshotA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden and effectively discloses key behaviors: it returns a filesystem path to a PNG in /tmp, specifies the output format ({ path, bytes }), and mentions a follow-up action (Read tool). However, it lacks details on potential errors or limitations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is front-loaded with the core purpose, followed by essential details on output and usage, with every sentence earning its place and no wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's moderate complexity (screenshot functionality with one optional parameter) and no output schema, the description is mostly complete, covering purpose, output, and a follow-up action, though it could include more on error handling or constraints.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, so the baseline is 3. The description adds minimal value beyond the schema by implying the selector is optional and used for targeting elements, but does not provide additional syntax or format details.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('Screenshot') and resource ('the current page or a specific element selector'), distinguishing it from sibling tools like designer_close, designer_open, and designer_pick by specifying its unique screenshot functionality.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides clear context for usage by specifying 'the current page or a specific element selector' and mentions an alternative action ('Read with the Read tool'), but does not explicitly state when not to use it or compare directly to sibling tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• designer_pickA
  4.6/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It effectively describes the interactive nature of the tool (user clicks/drags/annotates), cancellation behavior, and output file handling (PNGs in /tmp). However, it doesn't mention potential side effects like browser focus changes or performance considerations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is efficiently structured with bullet-like formatting for the three modes, each clearly explaining the user interaction and return values. Every sentence adds essential information about functionality, cancellation, or output handling with zero wasted text.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no annotations and no output schema, the description provides comprehensive context about the interactive process, return data structures, and file outputs. The only minor gap is lack of explicit mention about whether this tool requires specific browser state or permissions.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has 100% description coverage with clear enum values and descriptions. The description adds significant value by detailing what each mode returns (specific data structures like selector, rect, strokes, etc.) and operational differences between modes, going well beyond the schema's basic mode definitions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Activate the picker in the designer browser' with three specific modes (element, area, draw). It distinguishes from siblings like designer_close, designer_open, and designer_screenshot by focusing on interactive element/area selection and annotation rather than basic browser operations or screenshot capture.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit guidance on when to use each mode: element for clicking one element, area for dragging a marquee, and draw for freeform pen annotation. It also specifies 'Esc cancels in any mode' and mentions using the Read tool to open resulting PNGs, giving clear operational context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.