Server Quality Checklist

Tool Scores

• get_market_liquidityA
  3.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It discloses the cost of 6 credits per call and the auto-refund policy, adding context beyond the basic purpose. The term 'estimated' signals that the result is an approximation, further enhancing transparency about the nature of the output.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is exceptionally concise, with only two sentences. The core purpose is front-loaded, and the cost/refund information is efficiently stated without any redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple read-only tool with an output schema, the description is largely complete: it explains what the tool does, includes cost and failure handling, and the parameters are self-explanatory. However, the lack of usage guidance relative to sibling tools prevents a perfect score.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 0%, so the description must compensate by explaining the parameters. It does not mention make, model, or year at all, leaving the agent to rely solely on the parameter names. This is a significant gap since the description provides no additional meaning beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns estimated days-on-market (DOM) for a car in Poland, using a specific verb and resource. This distinguishes it from sibling tools like get_price_history and get_market_valuation, which deal with price and valuation rather than liquidity.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the use case—when you need to know how fast a car sells in Poland—but does not explicitly state when to use this tool over alternatives. It also omits any exclusions or prerequisite conditions, leaving the agent to infer the appropriate context from the tool's purpose.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_valuation_factorsA
  3.7/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description adds a key behavioral trait by stating 'Costs 12 credits per call; failed calls are auto-refunded,' which is not present in annotations (none provided). It does not explicitly declare the operation as read-only or discuss side effects, but for a quantification tool this is likely safe. The cost and refund information contributes some transparency, though it omits other potential details like rate limits or required auth.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description consists of two concise sentences: the first clearly states the purpose, and the second provides cost and refund behavior. There is no redundant or filler content. The structure is front-loaded with the core function, making it easy to parse quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the presence of an output schema, the description does not need to detail return values. It covers the tool's purpose and cost/refund behavior. It does not explicitly mention the required input parameters (make/model/year), but the input schema provides that context. The description is short but sufficient for the agent to understand when and why to invoke this tool, though it could be slightly more complete by noting the need for make/model/year.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has zero description coverage for make, model, and year, and the description does not explain these parameters. It only says 'for this car' without specifying how to provide the car details. Since schema coverage is 0%, the description carries the burden to clarify parameters, but it fails to do so, leaving the agent to infer that make/model/year are the identifiers. The parameters are self-explanatory, but the description adds no semantic value beyond what the property names imply.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'Quantify the price impact of import status, gearbox type, and fuel type for this car.' This uses a specific verb (quantify) and resource (price impact of specific factors), distinguishing it from siblings like get_market_valuation which provides overall valuation. It is immediately understandable what the tool does.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context through its focus on factor-specific impact analysis, suggesting it is used when detailed factor contributions are needed rather than overall market value. However, it does not explicitly state when to use this tool versus alternatives like get_price_history or get_regional_pricing, nor does it mention any exclusions. This is implied usage but lacks direct guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_regional_pricingA
  3.8/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  This description discloses a credit cost of 8 credits per call and auto-refund on failed calls, adding useful operational context beyond the schema. Since no annotations are provided, this cost and refund behavior is valuable, though it does not explain other behaviors like rate limits or data freshness.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is just two sentences: the first front-loads the core purpose, and the second adds the cost/refund detail. No unnecessary words or repetition of schema information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has an output schema, so return values need not be described, and the cost/refund info adds operational context. However, the lack of parameter semantics and the absence of any usage guidance leave gaps in completeness for a tool with three required inputs.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has 0% description coverage for its three parameters (make, model, year). The description does not elaborate on what these parameters mean or how they relate to the pricing comparison, leaving the agent to infer their purpose from the tool name alone.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool compares average prices across Polish voivodeships vs. the national average. The verb 'compare' and specific geographic scope distinguish it from siblings like get_price_history or get_market_valuation.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use the tool (when regional price comparison is needed) but does not explicitly mention when not to use it or contrast it with sibling tools. There is no exclusionary guidance or alternative tool references.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_price_historyA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of behavioral disclosure. It adds two important facts: the cost of 10 credits per call and auto-refund on failure. The 'get' nature and 'price trend' wording imply read-only behavior, but the description does not explicitly say that or describe rate limits, though the output schema presumably documents return data.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the primary purpose, then the cost/refund note. No word is wasted, and each sentence adds essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the 4 parameters and no annotations, the description covers key aspects: purpose, usage context, cost, and refund. The output schema exists to document return values, so the description need not do so. The main gap is the lack of explicit usage guidance versus sibling tools, but overall it is adequate for a straightforward read operation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It adds the 'up to 24 months' limit, which clarifies the 'months' parameter. However, it does not explain the other parameters (make, model, year), though those are self-explanatory. The description gives some value but is not comprehensive.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states a specific verb and resource: 'Get monthly average price trend' for up to 24 months. It also names the intended purpose, 'to identify depreciation curves,' which distinguishes it from sibling tools focused on valuation, liquidity, and regional pricing.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a clear context (monthly price history for depreciation analysis) and notes the cost of 10 credits, implying careful use. However, it does not explicitly contrast with sibling tools or state when NOT to use it, lacking exclusions or alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_market_valuationA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden for behavioral disclosure. It discloses the exact statistics returned, the tolerance for mileage ('±30% band'), the credit cost per call, and that failed calls are auto-refunded. However, it does not mention potential error scenarios beyond failed calls or any rate limits.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is four well-structured sentences that stay on topic: purpose, name flexibility, filters, and cost/refund policy. Every sentence provides unique, useful information without redundancy, and the key purpose is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description covers the essential invocation details: required fields, accepted input variants, valid filter values, credit cost, and refund behavior. The presence of an output schema means return values need not be explained. It does not mention alternative tools or edge cases like missing data, but it is sufficiently complete for correct use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has no descriptions or enums, but the description compensates by clarifying how to format model names ('VW Golf', 'BMW 3 Series' or '320d'), providing allowed fuel types ('petrol/diesel/hybrid/electric/lpg or Polish values'), gearbox values, and mileage meaning with a percent tolerance. This adds essential semantics beyond the raw parameter names.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Get average, median, P25, and P75 prices for a specific make/model/year in Poland.' This is a specific verb+resource combination, and the distinct statistics distinguish it from sibling tools like get_price_history or get_market_liquidity, which focus on different aspects.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides usage hints like 'Natural names work' and optional filters, but it does not explicitly contrast with sibling tools or state when to prefer this valuation tool over alternatives like get_price_history or get_regional_pricing. The usage context is implied through the described output and filtering options.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.