Server Quality Checklist

Tool Scores

• verify_urlB
  3.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It does reveal the method ('direct fetch and the Internet Archive') and the checks performed, but it does not state whether the operation is read-only, mention failure modes, rate limits, or return format. This is adequate but not deeply transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences with no wasted words, front-loading the core purpose and immediately enumerating the verification checks. Every clause contributes either scope or method information, making it easy to scan and parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema and no annotations, the description should compensate by explaining return behavior and all parameter semantics. It fails to clarify expected_date or what the tool actually returns, and it does not address when to prefer verify_citation. The tool may be callable, but the agent lacks full context for correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate for all three parameters. It implicitly covers url and expected_content, but expected_date is completely unexplained, and the connection between expected_date and Wayback archival is left to inference. This is insufficient for full parameter comprehension.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Verify') and a specific resource ('a URL'), then enumerates the exact checks performed: resolution, status/redirect chain, Wayback archival, and optional text presence. This clearly distinguishes it from the sibling verify_citation by focusing on URL-level verification rather than citation checking.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool should be used when URL verification is needed, but it provides no explicit when-to-use versus verify_citation guidance, no exclusions, and no alternatives. An agent is left to infer the appropriate context from the tool's name and capability list.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify_citationA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  There are no annotations, so the description carries the full burden. It discloses the underlying data sources (Crossref with Retraction Watch) and the OpenAlex fallback when no DOI is given, which is genuinely informative. It does not describe output format or error behavior, but the data-source and fallback transparency is solid.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two focused sentences with no redundancy. It front-loads the action and specific checks, then provides data sources and input guidance. Every sentence contributes value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Purpose, data sources, fallback behavior, and required input are all covered. However, there is no output schema and the description does not indicate what the tool returns, leaving an agent without a clear picture of the verdict/report shape.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema coverage, the description compensates by naming all relevant fields (doi, title, authors, year, journal) and by stating the key requirement to provide a DOI and/or title. This adds meaning beyond the all-optional schema, though it lacks format examples.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific action ('Verify a citation') and defines what verification means: existence, retraction status, and field matching against the canonical record. This makes the tool's purpose concrete and clearly distinct from the sibling verify_url.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Usage is implied from the purpose, and the description does give an input requirement ('Provide a doi and/or a title'). However, it never explicitly addresses when to prefer verify_citation over verify_url or when not to use it, leaving the choice to inference.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.