Server Quality Checklist

Tool Scores

• breaking_changes_betweenA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Without annotations, the description provides significant behavioral detail: it reads real GitHub release notes and CHANGELOG fallback, covers every version in the range, and returns grouped notes newest first. It discloses the data source and output structure, which are non-obvious. Minor gaps: no mention of network dependency or potential failures, but the core behavior is transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two well-structured sentences: the first states what the tool does, the second provides usage timing and behavioral detail (source-grounded, fallback, grouping). No filler or redundant information; every clause earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Despite no output schema, the description clearly states the return format ('breaking notes grouped per version, newest first'). It covers purpose, usage context, data source, fallback behavior, and range semantics. It omits potential error conditions or performance implications, but for a read-only tool with 3 well-described params, the description is largely complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the baseline is 3. The description adds no parameter-level detail beyond the schema; it reinforces 'between two versions' but does not explain formats or edge cases. The schema already documents inclusive/exclusive bounds and package name examples, so the description adds no additional meaning.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Get') and resource ('source-grounded list of BREAKING CHANGES for an npm package between two versions'), clearly distinguishing it from siblings like changelog_between (full changelog) and list_versions (version list). The scope is precise and immediately actionable.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly states when to use: 'Reach for this BEFORE writing or reviewing any dependency upgrade / migration'. It also explains why it's the right choice ('defeats the model's stale, hallucinated migration knowledge'). It does not name alternatives directly, but the timing and context make the intended usage clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• changelog_betweenA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the burden of disclosing behavior. It reveals that the output includes all release notes (not just breaking lines), the inclusive/exclusive range semantics, and the newest-first ordering. It does not mention error handling or potential network behavior, but these are less critical for a read-only fetch. The addition of the prose-style nuance adds useful context beyond a bare description.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the action ('Return the complete release notes') and followed by direct usage guidance. Every phrase earns its place, with no redundancy or filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a read-only retrieval tool with no output schema, the description provides enough operational context: purpose, boundaries, ordering, and use cases. The truncation behavior is covered by the maxChars parameter schema, so its absence from the description is not a gap. It does not specify what happens if the version range is invalid, but that is a minor omission for a tool of this simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema provides 100% coverage with clear descriptions for all four parameters. The description's phrase 'between from (exclusive) and to (inclusive)' restates the schema's own descriptions, adding no new semantic information. The maxChars parameter is fully described in the schema, so the description adds no extra value there.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns complete release notes between two versions, with explicit boundaries (from exclusive, to inclusive) and ordering (newest first). It distinguishes itself from the sibling tool breaking_changes_between by noting it returns 'not just breaking lines'.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says when to use it: when full context (new features, fixes, deprecations) is needed, or when breaking_changes_between reports prose-style breaking notes. It implicitly communicates when not to use it (when only breaking changes are needed), making the alternative clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_versionsA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It states the output is sorted newest first and includes release dates, which is useful behavioral context. It does not describe error handling or pagination, but for a read-only listing tool, the description provides adequate transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences with no filler. The first sentence states the primary function, and the second gives concrete use cases. Every word earns its place, and it is front-loaded with the essential purpose.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description covers purpose, sorting, and use cases, and names the related sibling tool. It does not describe the exact return structure, but there is no output schema and the tool is simple. The guidance for discovering from/to values makes the context sufficiently complete for an agent to invoke it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already describes both parameters: package name and limit with default 40. The description adds no additional parameter-level meaning, so the schema does the heavy lifting. Baseline 3 is appropriate because schema coverage is 100%.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states the tool lists published versions of an npm package with release dates, sorted newest first. This is a specific verb ('list') plus resource ('published versions of an npm package') and scope ('release dates, newest first'), and it clearly distinguishes from siblings like breaking_changes_between and changelog_between.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says to use it before calling breaking_changes_between to discover valid from/to values, and also to see how far behind an installed version is. This names a sibling tool and a concrete use case, which is clear guidance on when to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.