Server Quality Checklist

Tool Scores

• init-browserC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It states the action ('Initialize a browser') but doesn't explain what this entails—e.g., whether it launches a new browser instance, reuses an existing one, requires specific permissions, has side effects like network calls, or what happens on failure. For a tool with no annotations, this is a significant gap in transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with zero waste: 'Initialize a browser with a URL'. It is appropriately sized and front-loaded, clearly stating the core action without unnecessary details.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (initializing a browser, which could involve setup, navigation, and potential side effects), no annotations, and no output schema, the description is incomplete. It doesn't cover behavioral aspects like what 'initialize' means, error handling, or return values, leaving the agent with insufficient context for safe and effective use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, with the 'url' parameter fully documented in the schema as 'The URL to navigate to'. The description adds no additional meaning beyond this, such as URL format examples or constraints. Since the schema does the heavy lifting, the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Initialize a browser') and the target resource ('with a URL'), making the purpose understandable. However, it doesn't differentiate this tool from its siblings like 'get-full-dom' or 'get-screenshot', which might also involve browser interactions, so it doesn't reach the highest score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing a browser session first), exclusions, or how it relates to sibling tools like 'execute-code' that might also initialize contexts. This leaves the agent with minimal context for selection.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get-full-snapshotB
  3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It mentions the tool captures 'all visible content' but doesn't disclose behavioral traits such as performance implications, whether it requires browser initialization, potential rate limits, or how it handles dynamic content. This is inadequate for a tool with no annotation coverage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, well-structured sentence that efficiently conveys the core functionality without waste. It is front-loaded with the main action and resource. However, it could be slightly more concise by avoiding redundancy like 'etc.' after listing content types.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (capturing full page snapshots), lack of annotations, and no output schema, the description is incomplete. It doesn't explain what the snapshot output looks like (e.g., format, structure), performance considerations, or dependencies on tools like 'init-browser'. This leaves significant gaps for an AI agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 0 parameters with 100% coverage, so no parameter documentation is needed. The description appropriately adds no parameter information, focusing on the tool's purpose instead. A baseline of 4 is applied since no parameters exist, and the description doesn't introduce unnecessary details.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with a specific verb ('Get') and resource ('complete snapshot of the page'), and specifies what content is included ('all visible content including text, images, forms, etc.'). However, it doesn't explicitly differentiate from sibling tools like 'get-full-dom' or 'get-text-snapshot', which likely serve similar purposes, preventing a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides minimal guidance by stating the tool is for 'understanding the full context', which implies usage when comprehensive page analysis is needed. However, it lacks explicit when-to-use advice, alternatives (e.g., vs. 'get-text-snapshot' for text-only), or exclusions, leaving the agent with limited direction.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get-screenshotB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but only states the basic action. It doesn't disclose behavioral traits such as whether this requires a browser session, what format the screenshot returns (e.g., image data, file path), potential errors, or performance implications.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with no wasted words. It's front-loaded with the core action, making it easy to scan and understand quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (likely medium for browser interactions) and lack of annotations/output schema, the description is incomplete. It doesn't cover return values, error conditions, or dependencies on other tools like 'init-browser', leaving significant gaps for an agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters, and schema description coverage is 100%, so no parameter documentation is needed. The description doesn't add parameter details, but that's appropriate here, earning a baseline score above 3 for zero-parameter tools.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('Get') and resource ('screenshot of the current page'), making the purpose immediately understandable. However, it doesn't explicitly differentiate from sibling tools like 'get-full-snapshot' or 'get-interactive-snapshot' which might also capture visual elements, so it doesn't reach the highest score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an initialized browser), exclusions, or comparisons to siblings like 'get-full-snapshot' for more comprehensive captures.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get-text-snapshotB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but offers minimal behavioral disclosure. It states what content is retrieved but doesn't describe format (e.g., plain text, structured data), pagination, performance characteristics, error conditions, or authentication needs. For a tool with zero annotation coverage, this leaves significant gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core action ('Get all text content from the page') and adds clarifying details. It avoids redundancy and wastes no words, though it could be slightly more structured for readability.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no annotations, no output schema, and moderate complexity (extracting text content from a page), the description is incomplete. It lacks details on return format, error handling, performance, or how it differs from similar siblings like get-full-snapshot. The agent would need to guess key behavioral aspects.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters with 100% schema description coverage, so the schema fully documents the absence of inputs. The description appropriately doesn't add parameter details, maintaining focus on the tool's purpose. Baseline 4 is correct for zero-parameter tools.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('Get') and resource ('all text content from the page'), specifying the content types (headings, paragraphs, lists) and purpose (reading and content extraction). It distinguishes from siblings like get-full-dom (full DOM) and get-screenshot (visual), but doesn't explicitly contrast with get-full-snapshot or get-interactive-snapshot.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for 'reading and content extraction' contexts, suggesting when this tool might be appropriate. However, it doesn't provide explicit guidance on when to use this versus alternatives like get-full-dom or get-full-snapshot, nor does it mention prerequisites or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get-interactive-snapshotB
  3.4/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but only states what the tool does, not how it behaves. It doesn't disclose whether this is a read-only operation, if it requires browser initialization, potential performance impacts, rate limits, or what 'annotated screenshot' entails. The description adds minimal behavioral context beyond the basic action.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core action ('Get a snapshot') and immediately specifies the focus and output. Every word earns its place with no redundancy or unnecessary elaboration.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no parameters, no annotations, and no output schema, the description provides adequate basic purpose but lacks completeness. It doesn't explain what 'annotated screenshot' contains, how interactive elements are identified, or relationship to sibling tools like 'init-browser'. The context signals suggest simplicity, but more behavioral detail would be helpful.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters with 100% schema description coverage, so the schema fully documents the absence of inputs. The description appropriately doesn't waste space discussing parameters, maintaining focus on the tool's purpose. Baseline for 0 parameters with full coverage is 4.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with specific verbs ('Get a snapshot') and resources ('interactive elements'), and distinguishes it from siblings by specifying the focus on UI automation elements. However, it doesn't explicitly differentiate from similar tools like 'get-full-snapshot' or 'get-screenshot' beyond mentioning 'annotated screenshot'.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context for UI automation with interactive elements, but provides no explicit guidance on when to use this tool versus alternatives like 'get-full-dom' or 'get-screenshot'. It mentions 'annotated screenshot' which suggests a visual output, but doesn't clarify trade-offs or prerequisites.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• execute-codeA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but only partially discloses behavioral traits. It mentions the execution environment (Playwright JS) and that code must be an async function with a page parameter, but lacks details on permissions needed, error handling beyond the response structure, rate limits, or whether execution modifies page state. The description adds some context but leaves significant behavioral aspects unspecified.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that directly states the tool's purpose with zero waste. It uses minimal words to convey essential information, making it highly efficient and easy to parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (executing arbitrary code with potential side effects) and lack of annotations and output schema, the description is incomplete. It covers the basic purpose and parameter requirement but omits critical details like safety warnings, execution constraints, or expected output behavior beyond the schema's example, leaving gaps for an AI agent to use it correctly in varied contexts.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents the single parameter 'code' with detailed examples and response format. The description adds no additional parameter semantics beyond what's in the schema, meeting the baseline of 3 for high schema coverage without extra value from the description.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('Execute custom Playwright JS code') and target resource ('against the current page'), distinguishing it from sibling tools that retrieve data or initialize the browser rather than executing code. It uses precise technical language that leaves no ambiguity about what the tool does.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by specifying 'against the current page,' suggesting it should be used after browser initialization and when you need to run custom JavaScript code. However, it doesn't explicitly state when NOT to use it or name alternatives among the sibling tools (e.g., when to use this vs. get-full-dom for DOM retrieval).

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get-full-domA
  4.4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states what the tool does (gets the full DOM) and its deprecated status, but doesn't provide additional behavioral context such as performance characteristics, potential limitations, or what 'full DOM' specifically entails. The description adds some value but lacks rich behavioral details.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise with just two sentences that each earn their place: the first states the core functionality, and the second provides crucial deprecation guidance. There is zero waste or redundancy, and the most important information (the deprecation warning) is appropriately placed.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given that this is a zero-parameter tool with no output schema and no annotations, the description provides adequate context by stating what it does and its deprecated status. However, it doesn't explain what 'full DOM' means or what format the output might be in, which could be helpful for an agent. The deprecation warning is the most critical contextual element and is well-covered.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters with 100% schema description coverage, so the schema already fully documents the parameter situation. The description doesn't need to add parameter information, and it appropriately doesn't attempt to do so. A baseline of 4 is appropriate for zero-parameter tools where the schema handles all parameter documentation.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('Get') and resource ('full DOM of the current page'), making the purpose immediately understandable. It also distinguishes itself from siblings by mentioning a deprecated status and alternative tool ('get-context'), which helps differentiate it from other snapshot-related tools like get-full-snapshot or get-text-snapshot.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit guidance on when NOT to use this tool ('Deprecated, use get-context instead'), which is crucial for agent decision-making. This directly addresses the alternative tool and effectively communicates that this tool should be avoided in favor of the recommended alternative.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.