Server Quality Checklist

Tool Scores

• audit_urlA
  3.8/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden and discloses key behaviors: it returns a readiness level, score percentage, and individual check results, and defines the 0-5 scale. It also notes plan limits (5 audits/day free, unlimited Pro), adding useful operational context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and front-loaded, with no wasted words. It states the purpose, then the return value, the scale meaning, and plan limits in four short sentences, each earning its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has a single parameter and no output schema, but the description covers the essential return value semantics (level meanings) and rate limits. It is complete enough for an agent to select and invoke the tool correctly, though it could mention error handling or prerequisites.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already fully describes the only parameter (url) with 100% coverage. The description adds no additional parameter-specific meaning beyond what the schema provides, so the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function with a specific verb and resource: 'Audit a website for AI/agent readiness.' It also distinguishes itself from siblings by focusing on a single website and describing its specific output, unlike bulk_audit or compare_urls.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description does not provide explicit guidance on when to use this tool versus alternatives like bulk_audit or compare_urls. It mentions plan limits but gives no contextual cues for tool selection.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• compare_urlsA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry full behavioral disclosure. It does state plan limitations (Free up to 2 URLs, Pro up to 8) and that it 'Returns scores and check results for each URL,' which gives some insight into output. However, it does not describe auth requirements, error handling, or how 'agent readiness' is computed, leaving significant behavioral gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise, with three sentences that each serve a clear purpose: stating the core action, specifying plan limits, and indicating the return type. It is front-loaded with the most critical information and contains no filler or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given that there is no output schema, the description should clarify what 'scores and check results' include in more detail. It also does not explain the meaning of 'agent readiness' or define how the comparison is performed. While the single parameter and simple purpose reduce complexity, the description leaves gaps in understanding the output and tool nuances, making it adequate but not comprehensive.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already fully describes the single parameter 'urls' with min/max items and plan-based limits (100% schema description coverage). The description repeats these limits without adding any new semantic meaning or examples. Therefore, it adds no extra value beyond the schema, warranting the baseline score of 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'Compare websites side by side for agent readiness.' The verb 'compare' and the resource 'websites' are specific, and the phrase 'side by side' distinguishes it from single-URL audit tools like audit_url. It also implies a comparison use case that differs from bulk_audit and get_leaderboard.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implicitly provides usage context by focusing on comparison of multiple URLs, which suggests it is appropriate when you need to evaluate several websites together. However, it does not explicitly mention when not to use it or name alternatives like 'use audit_url for a single URL.' Thus, it has clear context but lacks explicit exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_leaderboardA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the burden of behavioral disclosure. It adds that no authentication is required and that the data is public, covering access control. However, it does not disclose return format, ordering, or any potential side effects, though 'get' implies read-only. The description provides some transparency but lacks deeper behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise, consisting of two short sentences that immediately convey the tool's purpose and a key usage note. Every word earns its place, and there is no repetition of schema details.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with one optional parameter and no output schema. The description explains what the tool does and that no authentication is needed. While it does not detail the exact return values, 'leaderboard' strongly implies a ranked list of websites, and the schema covers the limit. Overall, it is adequately complete for the tool's simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema fully describes the 'limit' parameter with default and max values, so the description does not need to add much. The description does not mention the parameter at all, but the schema coverage is 100%, and the meaning of 'limit' is self-explanatory. Thus, a baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'Get' and identifies the resource as 'public leaderboard of top agent-ready websites'. This clearly distinguishes it from sibling tools like audit_url and bulk_audit, which focus on auditing rather than retrieving a leaderboard.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a clear context for when to use the tool: when the public leaderboard of agent-ready websites is needed. It also explicitly notes that no authentication is required, which is useful usage information. However, it does not mention exclusions or alternatives, though the tool's purpose is distinct from its siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• bulk_auditA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses the batch size cap, the output structure (summary table with level and score), and the Pro subscription prerequisite. It does not explicitly state side effects (though audit implies read-only) or failure behavior, but the key behavioral traits are covered for a simple tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is three concise sentences, each conveying essential information: action and limit, return output, and subscription requirement. It is front-loaded with the primary purpose and contains zero filler or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with one simple parameter, no output schema, and no annotations, the description covers the purpose, input limit, output format, and key prerequisite. It lacks details on error handling or invalid URL behavior, but overall it is sufficiently complete for its simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%: the only parameter 'urls' is already described in the schema with 'List of URLs to audit (max 50, Pro only)'. The description merely reiterates the limit and Pro requirement without adding new parameter-specific meaning, so the baseline of 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Audit') and resource ('multiple websites'), with an explicit batch limit that distinguishes it from the sibling tool audit_url. It also specifies the return format ('summary table with level and score'), making the purpose unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly indicates when to use this tool: when auditing up to 50 websites at once. It does not explicitly name alternatives (e.g., audit_url for single URLs) or state exclusions, but the context is clear. The Pro subscription requirement also helps set expectations for usage.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.