Server Quality Checklist

Tool Scores

• calc_pressureB
  3.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must disclose behavior itself. It conveys that this is a non-mutating calculation and adds the hookless-rim-cap behavior, which is useful. Yet it does not describe return shape, possible failure cases, or assumptions about units for the numeric weights, so transparency is only partial.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two short, dense sentences with every phrase contributing. The core calculation and the special hookless-rim behavior are front-loaded, and there is no redundant boilerplate.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description is adequate for a simple calculator: it names the core inputs and output units. However, one required parameter (bike_weight) is missing from the prose, there is no output schema, and no assumptions or error conditions are documented, so an agent could still make incorrect assumptions about required input format or result structure.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It adds meaning by enumerating surface values (DRY/WET/SNOW) and specifying pressure in bar, but it omits the required paraméter bike_weight entirely and gives no units for rider_weight or bike_weight. This is a meaningful gap for an agent trying to invoke correctly.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Calculate'), the resource ('tire pressure'), and the output unit ('bar'), which distinguishes it from generic names. However, it does not explicitly differentiate itself from the sibling get_recommended_pressure, so it is clear but not fully differentiated.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'for a given bike, rider weight, and surface' implies when to use the tool, but there is no explicit guidance about when not to use it or when a sibling like get_recommended_pressure would be better. Usage context is implied rather than stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_recommended_pressureB
  3.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the burden of disclosing behavior. It clearly discloses the live-weather dependency, the wet/dry decision logic, and the bar-unit output format. It does not describe edge-case or error behaviors, but the core operational behavior is transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is short, front-loaded, and free of filler. The first phrase conveys the core value proposition immediately. The only minor issue is slight redundancy between 'live weather' and 'Fetches Open-Meteo data'.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with five required parameters, no output schema, and no annotations, this description is incomplete. It explains the high-level flow and output unit but omits essential parameter format details, especially how to specify the bike and what units the weights should use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description does not define the meaning, units, or allowed values of the five required parameters. It only hints that lat/lon are used for the Open-Meteo weather lookup and that weights feed the pressure calculation; crucial details like what 'bike' refers to and the weight unit are missing.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states what the tool does: it fetches Open-Meteo weather data, determines wet/dry conditions, and returns front/rear pressure in bar. This is a specific and understandable purpose, though it does not explicitly differentiate itself from the sibling calc_pressure.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'One-call recommended pressure with live weather' implies the main use case: getting a weather-aware recommendation in a single call. However, it does not explicitly state when not to use this tool or mention alternatives such as calc_pressure, so usage guidance is mostly implied rather than explicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_bikeA
  3.6/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations exist, so the description carries the behavioral disclosure burden. It communicates a read operation and reveals return content (specs + bike weight). It does not cover not-found or error behavior, which is a minor gap for a simple GET-like tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two short sentences with no unnecessary words. The core action and return summary are front-loaded, making it fast for an agent to parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a one-parameter read tool with no output schema, the description gives enough to invoke the tool and understand the response. It lacks detail on what 'specs' includes, but that does not affect correct selection or invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage, the description slightly compensates by stating the lookup is by name, giving the sole parameter purpose. It adds no format, uniqueness, or exact-match constraints, so the added value over the bare schema is modest.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Specific verb 'Get', resource 'bike profile', and 'by name' identifies the lookup mechanism. The word 'single' implicitly distinguishes from the sibling get_bikes, though no sibling is explicitly named.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Implied usage: use this tool to fetch one bike by name. It does not explicitly state when to prefer it over get_bikes or the pressure tools, so the agent must infer the boundary from sibling names and context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_bikesA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the transparency burden, and it clearly conveys a non-mutating list behavior plus the scope ('configured') and included fields. It does not mention response details or edge cases, but for a zero-parameter read operation the core behavior is transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The entire description is one well-structured sentence with no filler. It front-loads the action and resource, then appends the key output fields.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter list operation with an output schema, the description provides enough context: what is returned, the scope, and the fields. No prerequisite, input, or alternative-usage details are needed to call it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has no parameters, so the description does not need to clarify parameter meaning. It instead clarifies what the returned list contains, adding value beyond the empty input schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('List') with a clear resource ('all configured bike profiles') and enumerates the returned fields (name, tire/rim specs, style). This distinguishes it from singular get_bike and calculation-focused siblings like calc_pressure.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'List all' implies the tool is for retrieving the full set of bike profiles, but it does not explicitly contrast it with get_bike for a single profile or with pressure-related tools. Usage context is implied rather than stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.