Server Quality Checklist

Tool Scores

• list_storesC
  2.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden for behavioral disclosure. It implies a read-only listing and mentions an optional filter, but it does not explain how filtering behaves, whether results are paginated, what fields are returned, or whether the retailer value is required. The output schema may cover return shape, but the description adds little behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with no filler, and the core action is front-loaded. However, the conciseness comes at the expense of necessary detail about the query filter and usage context, so it is under-specified rather than efficiently complete.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With only two parameters, an output schema, and a simple listing operation, the tool is not highly complex. Still, the vague query semantics and lack of usage guidance leave noticeable gaps for an agent deciding how to invoke it correctly. It is minimally viable but not complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate for parameter meaning. It adds only 'with optional query filter,' which gives minimal meaning to 'query' without saying what it filters on (name, location, etc.). The 'retailer' parameter is not explained, though its enum values are self-explanatory.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a clear verb and resource: 'List physical stores for a retailer.' This distinguishes it from the sibling product/stock/price tools at a basic level. However, the 'optional query filter' is vague about what the query targets, which keeps it from being fully precise.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  There is no guidance about when to use this tool versus alternatives, and no exclusions or preconditions. The sibling names imply it is for store lookups rather than product searches, but that is left to inference rather than stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_productsC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  There are no annotations, so the description must carry full disclosure burden, but it only states the core search scope. It does not describe filtering behavior, defaults, rate limits, or what happens with invalid or empty results. The operation is likely read-only, which lowers risk, but behavioral detail beyond the bare action is missing.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, scannable sentence with no filler, and the retailer scope is front-loaded. It is concise, though it could have used the available space to add parameter guidance without harming readability.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With four parameters, no annotations, and zero schema property descriptions, this definition is too thin for an agent to call optimally. The output schema covers return values, but parameter semantics, defaults, and the relationship to sibling tools such as compare_price or get_product are not addressed.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It adds the retailer list inline, which aligns with the retailer parameter, and search implies the query parameter. However, max_price and max_results semantics are left entirely to the schema, with no explanation of how filtering or result limiting actually behaves.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb and resource: searching products, with a specific scope across Czech DIY retailers and even lists the allowed retailer values. It distinguishes itself from siblings like get_product and list_stores by emphasizing a cross-retailer product search, though it doesn't explicitly contrast them.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'search products across Czech DIY retailers' implies that this tool is for querying product availability across those retail chains. There is no explicit when-to-use or when-not-to-use guidance, and alternatives like get_product, get_stock, or compare_price are not mentioned, so the agent must infer the intended use case from sibling names.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_productB
  3.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. The verb 'Get' signals a read-only lookup, and 'detailed product information' implies a richer response than a search result. However, it does not disclose behavior for missing or invalid product IDs, retailer-specific data differences, or any authorization requirements, leaving notable gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with no filler, repetition, or unnecessary detail. The key lookup concept 'by product ID / SKU' is front-loaded, and every word earns its place. It is concise without being truncated.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple, the output schema exists, and the parameters are straightforward, so the description does not need to explain return values in depth. However, there are no annotations, no explicit usage routing among siblings, and no clarification of retailer semantics. This makes the description minimally viable but noticeably incomplete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It does clarify that product_id is an ID or SKU, but it says nothing about the retailer parameter, such as whether product_id is retailer-specific or how the retailer enum scopes the lookup. Only one of two parameters receives meaningful semantic treatment.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a concrete action ('Get') on a specific resource ('product information') and a precise lookup key ('product ID / SKU'). This distinguishes it from search_products, which finds products without an exact identifier, and from get_stock/compare_price, which focus on narrower aspects. Some vagueness remains in the word 'detailed,' but the core purpose is clear.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'by product ID / SKU' implies the correct use case is when an identifier is already known, and that search_products would be the alternative for discovering one. However, the description never explicitly states when not to use the tool or how to choose among the sibling tools, so the guidance remains only implicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• compare_priceA
  3.5/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full disclosure burden. It discloses one useful behavioral trait (results sorted ascending by price), but does not mention whether the comparison is real-time, how unavailable items are handled, or any other operational effects. The description adds some transparency but leaves significant gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, compact sentence with no filler or redundant information. Every word adds meaning, and the core action ('compare product prices') is front-loaded. It is an excellent example of concise, efficient writing.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  An output schema exists, so return values are covered. However, the description provides no guidance on how to fill the three input parameters, and 0% schema coverage leaves the agent in the dark about query semantics, retailer filtering, and result limits. The description is incomplete for a tool with this parameter complexity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate by explaining parameter semantics. It does not mention what 'query' should contain, how to use the 'retailers' filter, or what 'max_results_per_retailer' limits. The description is completely silent on all three parameters, making it impossible for an agent to construct correct arguments from the text alone.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('compare'), a clear resource ('product prices across DIY retailers'), and a distinct behavior ('sorted ascending by price'). This clearly differentiates it from siblings like search_products (searching general products) and get_stock (stock levels). An agent can immediately understand what the tool does.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description states a clear context: use this tool when you need to compare product prices across DIY retailers. It does not explicitly name alternatives or exclusions, but the purpose is specific enough for an agent to infer when to select it over the sibling tools. Lacks explicit 'when not to use' guidance, so not a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_stockA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden of disclosing safety and behavior. The verb 'Get' and the word 'current' clearly signal a read-only, real-time lookup with no destructive side effects. It does not conceal extra mutations or unexpected behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  One sentence, front-loaded with the action and object, with no filler or redundancy. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple read operation with a rich output schema, the description adequately conveys what is returned (stock level) and where (specific physical branch). It could mention a prerequisite like using list_stores to find store_id, but nothing critical is missing for correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, but parameter names (retailer, store_id, product_id) are self-explanatory and retailer has an explicit enum. The description adds useful context by tying the tool to a 'specific physical store branch,' but it does not explain each parameter's format or relationship in detail.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific verb ('Get'), a clear resource ('current product stock level'), and a precise scope ('at a specific physical store branch'). This clearly distinguishes it from siblings like get_product (product details) and compare_price (pricing comparisons).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'at a specific physical store branch' implies when this tool should be used and that it requires a store_id. However, it never explicitly names alternatives or says when not to use it, so an agent must infer the routing to sibling tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.