Server Quality Checklist

Tool Scores

• search_googleC
  2.7/5.0
  Behavior1/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure but offers none. It doesn't mention whether this is a read-only operation, if it requires authentication, what rate limits might apply, what format results come in, or any other behavioral characteristics beyond the basic action.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise at just 5 words, front-loading the essential information with zero wasted words. Every word earns its place in communicating the core functionality.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a search tool with no annotations and no output schema, the description is insufficiently complete. It doesn't explain what kind of results to expect, whether there are limitations on queries, or any other contextual information needed for effective use beyond the bare minimum.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, with the single parameter 'query' already documented in the schema. The description adds no additional semantic context about the parameter beyond what's in the schema, so it meets the baseline for high schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Search Google for a query' clearly states the action (search) and target resource (Google), making the purpose immediately understandable. It doesn't differentiate from sibling tools like 'take_screenshot' or 'visit_page', but those perform completely different functions, so differentiation isn't critical here.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. While the sibling tools are functionally different, there's no mention of when to prefer this search tool over other potential search methods or when it might be inappropriate to use.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• visit_pageC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden but provides minimal behavioral context. It mentions 'extract its content' but doesn't specify what content (e.g., HTML, text, metadata), how extraction works (e.g., parsing, rendering), or any constraints (e.g., rate limits, authentication needs, timeouts). The description doesn't contradict annotations (none provided), but lacks critical operational details.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with zero waste. It's front-loaded with the core action and outcome, making it easy to parse. Every word earns its place, and there's no redundant or verbose phrasing.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (web interaction with potential side effects like network calls), lack of annotations, and no output schema, the description is incomplete. It doesn't cover return values, error handling, performance characteristics, or dependencies. For a tool that likely involves external resources and mutation-like behavior (extracting content), more context is needed.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents both parameters ('url' and 'takeScreenshot') adequately. The description adds no additional parameter semantics beyond what's in the schema (e.g., no format details for URL, no explanation of how screenshot integrates with content extraction). Baseline 3 is appropriate as the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('visit') and resource ('webpage'), and specifies the outcome ('extract its content'). It distinguishes from 'search_google' (which searches) and 'take_screenshot' (which only captures images), but doesn't explicitly differentiate from siblings beyond implied scope. The purpose is specific and actionable.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit guidance on when to use this tool versus alternatives is provided. The description implies usage for content extraction from a known URL, but doesn't mention when to prefer 'search_google' (for finding URLs) or 'take_screenshot' (for visual capture only). There's no context on prerequisites, limitations, or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• take_screenshotB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but only states the basic action without disclosing behavioral traits. It doesn't mention what happens after the screenshot (e.g., saved location, format, permissions needed, or error conditions), which is critical for a tool with potential side effects.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core action without any wasted words. It's appropriately sized for a simple tool with no parameters, making it easy for an agent to parse quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (simple action but with behavioral implications) and lack of annotations/output schema, the description is incomplete. It doesn't address what the tool returns (e.g., file path, base64 data) or error handling, leaving significant gaps for agent invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters with 100% schema description coverage, so the baseline is 4. The description doesn't need to add parameter details, and it correctly implies no inputs are required for this operation.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('take') and target resource ('screenshot of the current page'), making the purpose immediately understandable. However, it doesn't differentiate from potential siblings like 'capture_region' or 'record_screen', which would require explicit comparison to achieve a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like 'search_google' or 'visit_page'. It lacks context about prerequisites (e.g., needing an active page) or exclusions (e.g., not working on certain page types), leaving the agent with minimal usage direction.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.