Server Quality Checklist

Tool Scores

• search-spines-undergroundB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, so the description must convey behavioral traits. It implies a read operation but doesn't explicitly state safety, permissions, or result characteristics. Minimal beyond the obvious.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences directly convey the tool's purpose without extraneous information. Front-loaded with action and resource.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the simple input schema (one required string) and no output schema, the description adequately explains what is being searched but omits details like result format, pagination, or rate limits. It is minimally complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the parameter is already well-defined in the schema. The description adds example search terms, which provides some additional context, but no further semantic value beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'Search', the resource 'Spine's Underground catalog', and the scope 'by keyword', specifying the fields searched (product names, descriptions, shop names). This distinguishes it from sibling tools like browse-spines-underground.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives, nor any when-not or prerequisite conditions. Sibling tools are listed but not compared.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get-free-contentA
  3.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the full burden. It mentions 'Content delivered inline' but does not disclose behavioral traits such as error handling for invalid product IDs, authentication requirements, rate limits, or side effects. Minimal disclosure beyond purpose.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise (two sentences) with front-loaded purpose. Every sentence adds value: the first states the action and source, the second provides useful specifics about product counts. No wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter tool with no output schema and no annotations, the description is fairly complete. It covers what the tool does, the type of content, and delivery mechanism. Minor gaps include lack of error handling or edge case description, but these are acceptable given the tool's simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Input schema has 100% description coverage for the single parameter 'product_id', including example values. The description adds no new semantic meaning beyond the schema; it only mentions the count of free products. Baseline 3 is appropriate since schema already documents the parameter well.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly states the verb 'get', the resource 'free content or tool info from Spine's Underground', and enumerates the 13 free products with categories. It distinguishes from sibling tools like browse, buy, search, and verify-receipt by focusing on free content retrieval.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for accessing specific free products by ID, but does not explicitly state when to use this tool over siblings like browse-spines-underground or search-spines-underground. No exclusions or alternatives are mentioned.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• buy-from-spines-undergroundA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must fully disclose behavior. It explains the return (x402 payment challenge) and payment method (USDC on Base), but omits details on post-payment behavior, idempotency, or what happens if already purchased. This leaves important gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences convey purpose, mechanism, and scope efficiently. No redundancy, and critical information is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (payment challenge, on-chain payment), the description covers the core flow and pricing. However, it lacks details on the response structure after payment or error handling. With no output schema, slightly more context would improve completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% and includes example product IDs, so the description adds minimal new meaning (pricing and count of products). Baseline 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('purchase paid content') and specifies the resource ('Spine's Underground'), distinguishing it from siblings like browsing or searching. It also mentions the mechanism (HTTP 402 challenge, pay USDC) and scope (10 products, $1.99-$4.99), making purpose highly specific.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when the user wants to buy paid content, but does not explicitly state when not to use it or provide alternatives (e.g., browse first, verify receipt). It assumes familiarity with the payment flow, lacking guidance on prerequisites.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• browse-spines-undergroundA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses the catalog content but does not mention behavioral traits such as being read-only, safety, or any authentication/rate limit requirements. For a read operation, this is adequate but not exhaustive.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, well-structured sentence with essential information front-loaded. Every part adds value, and there is no redundancy or verbosity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema, the description provides sufficient context about return content (catalog items, categories, pricing). It is complete for a simple browse tool, though it could hint at output format or pagination if present.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, and the schema already describes the single optional parameter clearly. The tool description adds contextual information about the catalog count and pricing but does not enhance parameter semantics beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: browsing the Spine's Underground catalog. It specifies the scope (23 curated products), categories, and pricing, distinguishing it from sibling tools like buy, search, or verify.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implicitly guides usage by mentioning optional product_id for single product detail, suggesting when to omit for full catalog. However, it does not explicitly state when to use this tool over siblings like search-spines-underground.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify-receiptA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations provided. Description discloses that it verifies payment and delivers content, but lacks details on idempotency, error handling, or side effects (e.g., marking payment used). Adequate but incomplete.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences: first states purpose, second details usage condition. No fluff, front-loaded, and efficient.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With 2 simple params and no output schema, the description explains what the tool does and when to use it. It does not specify the exact output format (e.g., URL or file), but it is sufficient for a verification tool. Almost complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema has 100% coverage with descriptions for both parameters. Description adds value by specifying the blockchain (Base) and providing examples for product_id, which augments the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'verify' and resource 'USDC payment' with the goal to 'receive purchased content'. It distinguishes from siblings like buy-from-spines-underground by specifying the use case for on-chain USDC transfer verification.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides clear context for when to use: after a direct USDC transfer (not x402). Does not explicitly exclude other scenarios or name alternatives, but the condition is well-stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.