Server Quality Checklist

Tool Scores

• whois_lookupA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full responsibility for behavioral disclosure. It lists the output content but does not explicitly state the operation is read-only, nor does it mention potential limitations like unsupported TLDs, rate limits, or data completeness. While 'Retrieve' implies a safe read, the absence of any caveats or side-effect disclosure leaves behavioral transparency below the level expected when annotations are absent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences long, with the primary purpose and data types listed first, followed by a brief use-case sentence. Every word earns its place; there is no redundancy or filler. The front-loading of the action and scope helps an agent quickly understand the tool's role.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple (single parameter, no output schema), and the description covers the essential details: what it returns and why it is useful. Missing are explicit error scenarios (e.g., invalid domain, unsupported TLD) and confirmation of read-only behavior, but given its simplicity, these are minor gaps. The list of returned data fields gives enough context for an agent to anticipate the response.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already fully describes the parameter (e.g., 'example.com' with protocol/path exclusion), and schema coverage is 100%. The description does not add any extra meaning about the domain parameter—it only restates 'domain name' in the purpose, which does not enrich the schema's guidance. This aligns with the baseline of 3 for full schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool retrieves WHOIS registration data for a domain, naming the exact resource and action. It enumerates the specific data returned (registrar, dates, nameservers, contacts, DNSSEC, age), which sharply distinguishes it from siblings like dns_lookup, ssl_check, and domain_availability.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description mentions it is 'useful for checking domain ownership and registration info,' which gives a concrete use case. However, it does not explicitly contrast with sibling tools or state when to prefer this over them (e.g., 'for DNS resolution use dns_lookup'). The guidance is implied but not explicit, so an agent might not always know the right tool to pick.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• domain_availabilityA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden. It discloses that the tool returns a boolean and checks registration availability, which is core behavior. However, it does not mention error cases (e.g., invalid domain format, network failures) or any rate limits. For a simple tool this is acceptable, but more detail on response failure modes would improve transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences with no filler. The key information—purpose and return type—is front-loaded, and the usage hint is brief. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with a single parameter and a boolean output, the description is complete: it states the purpose, the output type, and a typical use case. It does not mention potential edge cases or failure modes, but these are not critical for a simple availability check. Overall, it provides everything an agent needs to decide when and how to call it.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already describes the 'domain' parameter with an example, providing 100% coverage. The description adds no additional meaning to the parameter beyond what the schema states. Since schema coverage is high, a baseline of 3 is appropriate; the description does not need to repeat the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly states the verb 'Check' and the specific resource 'domain name available for registration'. It also specifies that it returns a boolean, which immediately distinguishes it from sibling tools that perform whois, DNS, or SSL checks. No confusion about what this tool does.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives a clear use case: 'finding an unregistered domain before attempting to register it.' While it doesn't explicitly exclude alternatives like whois_lookup, the different purpose (availability vs. record lookup) is intuitive. Could have mentioned that other tools are for DNS/SSL checks, but the context is adequate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ssl_checkA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It states the action ('Retrieve and validate') and lists the data returned, which is useful. However, it does not disclose any network behavior (e.g., that it makes a live connection to the domain), potential latency, or error conditions. For a read-only check this is acceptable, but it leaves some behavioral details implicit, warranting a mid-range score.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the core action and resource. The second sentence efficiently enumerates the return fields and use cases. There is zero redundancy or filler; every clause earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple tool with one parameter and no output schema, the description covers all essential information: what it does, what data it returns, and ideal usage scenarios. It could be slightly more complete by noting that it performs a live network check or how it handles unreachable domains, but these are minor gaps. The absence of an output schema is compensated by the explicit list of returned fields.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has only one parameter, 'domain', which is fully described with an example ('example.com') and explanation. Since schema description coverage is 100%, the description adds no additional semantics beyond what the schema already provides. Per the rubric, baseline is 3, which is appropriate here.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with the specific verb-resource pair 'Retrieve and validate the SSL/TLS certificate details for a domain' and enumerates the exact fields returned (issuer, validity period, fingerprints, SANs, etc.). It is clearly distinct from the sibling tools (whois_lookup, dns_lookup, domain_availability) because it targets certificate data specifically. No ambiguity remains about what this tool does.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description includes an explicit 'Useful for checking certificate expiry, verifying the issuer, or auditing TLS configuration' clause, giving concrete scenarios. It does not, however, name the sibling tools or state when NOT to use it (e.g., 'for DNS records use dns_lookup'). This is clear context without exclusions, aligning with a 4 rather than a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• dns_lookupA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It transparently states that the tool returns 'all available record types' and lists them, which is the key behavioral trait. It does not mention error handling, rate limits, or security requirements, but for a simple read-only lookup, this is reasonably complete.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, information-dense sentence that front-loads the action ('Query DNS records') before detailing record types and use cases. It is not overly verbose and avoids redundancy with the schema, earning a score above baseline.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (one parameter, no output schema) and the presence of siblings, the description adequately covers what an agent needs to know to call it correctly: what it does, what it returns, and typical use cases. It does not explicitly address edge cases like NXDOMAIN or empty responses, but these are minor for a lookup tool and the description is otherwise complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already covers the domain parameter fully (100% coverage) with format guidance and examples. The description adds no additional parameter semantics beyond 'domain name', so the baseline score of 3 is appropriate per the rubric.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Query') and resource ('DNS records for a domain name'), and enumerates the exact record types returned (A, AAAA, MX, NS, etc.). This clearly distinguishes it from sibling tools like whois_lookup or ssl_check, which target different aspects of domain infrastructure.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit use cases ('diagnosing DNS configuration, verifying mail settings, or auditing domain infrastructure'), which implicitly indicate when this tool is appropriate. However, it does not directly contrast with alternatives or state when not to use it, leaving some inference to the agent.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.