Server Quality Checklist

Tool Scores

• get_sports_oddsA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description discloses a key behavioral limitation: bookmaker coverage varies widely (as few as 1 bookmaker on some competitions) and instructs the agent to report the number of books rather than implying full market. It does not address other behaviors like response structure, pagination, or error handling.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three sentences with each earning its place: purpose, usage examples, and a caveat. High signal-to-noise ratio and front-loaded with the core functionality.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description omits how odds are returned (e.g., a list of games versus a single event), and the example 'odds for the <team> game' implies event-level filtering that the schema does not support (only sport_key). Without an output schema, the agent lacks guidance on response shape. The thin-coverage caveat is helpful but not sufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  All five parameters are fully described in the schema with examples and defaults, so the description adds little parameter-level detail. It does reinforce the concept of 'from every bookmaker' relevant to the bookmakers parameter, but the baseline 3 applies because the schema already carries the load.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns head-to-head and other market odds for a single sport from all covering bookmakers, with concrete example queries. It distinguishes itself from racing tools by noting that sports coverage is thinner.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides explicit use-case examples ('odds for the <team> game', 'who is favourite in the NRL tonight') and implies this is for sports rather than racing. However, it does not name sibling tools or explicitly state when to prefer racing_best_odds or get_best_odds.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• racing_resultsA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the behavioral transparency burden. It adds useful context (settled, already run, finishing order and dividends) but does not disclose read-only safety, default lookback window, or availability limitations beyond what the schema already implies.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences with no wasted words. The first sentence states core functionality and output, the second provides usage context and an exclusion. Well front-loaded and easy to scan.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no output schema, it explains the return content (finishing order/dividends) and filters by context. However, it omits that results are only available for a limited lookback window (hours_back max 168, default 24), which could mislead an agent expecting arbitrary historical results.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the baseline is 3. The description adds no parameter-specific meaning beyond the schema; limit, venue, categories, and hours_back are already fully documented in the input schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description explicitly states it provides 'Settled results for Australian races that have already run — finishing order and dividends' and clarifies the use case ('who won the <race> at <venue>'). It also distinguishes from siblings by noting 'Not for upcoming races.'

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Gives clear when-to-use examples ('who won...' or 'check a past result') and an explicit exclusion ('Not for upcoming races'). However, it does not name a specific alternative tool such as racing_next_to_go, which would make the guidance stronger.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_best_oddsA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden. It discloses the core behavioral trait (returns single best price and bookmaker per selection), which is useful context beyond the schema. It doesn't mention details like return format or pagination, but for a simple read-only tool this is acceptable.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences, zero filler. The first sentence states the output, the second provides usage guidance. Front-loaded and efficient.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With a single required parameter fully documented in the schema and no output schema, the description adequately explains the return value (best price and bookmaker per selection). It could add more detail about selection scope (e.g., all selections for the sport), but is largely complete for the tool's simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already covers the sole parameter 'sport_key' with a description and example, giving 100% coverage. The description adds only 'for one sport', which reinforces but doesn't meaningfully extend the schema's meaning. Baseline 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('get') and clearly states the tool returns 'the single best price per selection for one sport' and 'which bookmaker offers it'. It distinguishes from alternatives by contrasting with 'every book's line'.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says 'Use when the user wants the best available price rather than every book's line', providing a clear use case. It implies when-not but doesn't name a specific alternative tool, so a slight deduction from 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• racing_best_oddsA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full responsibility. It discloses the output (best price per runner and bookmaker) and scope (upcoming Australian races), but lacks detail on data sources, edge cases (e.g., no races found), or any other behavioral nuances. It is clear it is a read-only lookup, but adds only basic context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and front-loaded, starting with the core purpose in the first sentence and following with two practical example queries. It contains no filler or redundant information, making it easy to scan and understand quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple query tool with no output schema and no annotations, the description covers the main outputs (best price and bookmaker), the scope (upcoming Australian races), and example usage. It does not describe return format, but the examples and clear purpose make it sufficient for most agent interactions. Minor gaps include handling of multiple categories or bookmaker restrictions, which are covered by the schema.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the input schema fully documents all four parameters. The description adds context about the tool's intent (best price) but does not enrich the meaning of individual parameters beyond what the schema already provides. Therefore, the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: providing 'the single best available price for each runner in upcoming Australian races' and the offering bookmaker. It distinguishes itself from a full-comparison tool by saying 'Use this when the user wants the best price rather than a full comparison across every book,' which sets it apart from siblings like get_best_odds.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly tells when to use this tool: 'Use this when the user wants the best price rather than a full comparison across every book.' It also provides concrete example phrasings ('where is the best odds on <horse>', 'best price in the next race'), making it easy for an agent to recognize relevant user requests.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• racing_moversA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, so the description carries the full burden of behavioral disclosure. It adds meaningful context by explaining that a move confirmed by multiple bookmakers is more reliable and that min_books prevents false signals, but it does not disclose return format, latency, rate limits, or edge cases like no results or partial data.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three sentences, each earning its place: purpose, usage context, and a practical nuance. Front-loaded with the core definition, no filler, and appropriately sized for the tool's complexity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has 6 parameters but no output schema. The description covers purpose, usage scenarios, and a critical domain concept (multi-book confirmation). It doesn't explain what the output looks like or how to combine parameters, but given sibling tools and schema coverage, it is reasonably complete for a data-retrieval tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so baseline is 3. The description goes further by giving purpose to min_books ('guards against reading noise as a signal') and by clarifying the direction semantics through 'firming (shortening) or drifting (lengthening)', which adds value beyond the schema's enum labels.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly captures purpose with a specific verb-resource: 'Runners whose price has moved sharply across the market — firming (shortening) or drifting (lengthening).' It also alludes to distinct use cases ('what's being backed', 'any big movers today') without confusing it with sibling tools like racing_best_odds or racing_results.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly states when to use the tool: 'Use this for "what's being backed", "any big movers today", or market-sentiment questions.' It provides a key conceptual guideline about min_books confirming moves, though it stops short of naming alternative tools or saying when not to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• racing_next_to_goA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of behavioral disclosure. It goes beyond the obvious by explaining that each race reports data_age_seconds and each price its own age, allowing the agent to accurately describe freshness instead of implying live-to-the-second data. This is meaningful added context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences, both dense with purpose and usage. The first defines the exact output, the second provides example queries and a behavioral note. No wasted words, and the key differentiation ('primary tool') is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a read-only tool with no output schema, the description covers the core: what races are returned, the bookmaker/runner format, and data freshness. It could optionally mention that results are sorted by start time or include pagination, but for a simple 'next to go' endpoint, this is sufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, and the schema already provides rich guidance (e.g., the country parameter explains why passing AU is important and gives bookmaker count statistics). The description adds no parameter-level semantics beyond what the schema already offers, so the baseline of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns the next Australian horse, greyhound, and harness races with every bookmaker's price for every runner. It then gives concrete example questions ('what's racing next', 'who is favourite in the next race at <venue>') that distinguish it from price-comparison or historical-result tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly says 'This is the primary tool' and lists precise use cases for current Australian racing prices. It stops short of naming sibling tools as alternatives or stating when not to use it, so it misses the explicit exclusion guidance seen in the top calibration example.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• racing_eventsA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It transparently states that runner prices are not included and that the tool is cheaper than the alternative, which are important behavioral traits. It does not mention output format or error handling, but for a simple read-only schedule tool, the disclosure is adequate.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences long, front-loaded with the core content in the first sentence and usage guidance in the second. Every part adds value with no filler or redundancy, making it highly concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a low-complexity tool with three well-schema-covered parameters and no output schema, the description provides all necessary context: what the tool returns, what it excludes, when to use it, and how it compares to a sibling. The description is complete enough for an agent to select and invoke the tool correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema provides full descriptions for all three parameters (country, categories, hours_ahead), so the baseline is 3. The description adds minimal parameter-specific insight beyond implying a look-ahead window via 'what meetings are on today', which maps to hours_ahead. It does not compensate for any gaps since there are none.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies the resource ('upcoming Australian race schedule') and the specific content (venues, race numbers, jump times) while explicitly excluding runner prices. It distinguishes itself from sibling tools like racing_next_to_go by noting the cost difference and lack of prices, making its purpose unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives explicit usage guidance: 'Use this for "what meetings are on today" or to find a race_id before asking about it.' It also names an alternative (next_to_go) and tells when this tool is preferable ('Cheaper than next_to_go when prices are not needed'), providing clear context for tool selection.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• account_usageA
  4.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must carry the burden of behavioral disclosure. It implicitly indicates a read-only operation by describing credit usage remaining balance, but it does not explicitly state the operation is non-mutating or mention potential limitations (e.g., rate limits). The description is adequate for a simple query tool but leaves some behavioral aspects unstated.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the tool's purpose and immediately followed by explicit usage conditions. Every word earns its place—no repetition or filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter tool with no output schema, the description is fully sufficient. It covers what the tool provides (credit usage and remaining balance) and when to invoke it, making it complete for an agent to select and use without further clarification.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema is empty (0 parameters), so the baseline is 4. The description adds no parameter-specific details because none exist; it correctly describes the tool as having no inputs, so no additional semantic value is needed.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool reports 'this API key's credit usage and remaining balance for the month,' which is specific and distinguishes it from the sports-related sibling tools. Though it lacks an explicit verb, the intent (returning account usage) is unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicit when-to-use guidance is provided: 'Use it when a call has been refused with a 402, or when the user asks how much of their quota is left.' This gives clear context and directly instructs the agent on appropriate invocation scenarios.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_sportsA
  4.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It discloses what the tool returns (sport_key for all sports) and explicitly notes that 'horse-racing' is absent, directing to racing_* tools. However, it does not detail the exact return structure (e.g., array format), which is a minor gap for a no-arg list tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three concise sentences: purpose, usage, and a critical caveat. Every sentence adds value, and the purpose is front-loaded. No redundant or filler content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple no-parameter list tool, the description is complete: it states what is returned, when to use it, and a notable exclusion (horse-racing). It also references sibling tools, providing enough context for an agent to select and invoke it effectively.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters, so the parameter semantics baseline is 4. The description adds no parameter-specific information, but none is needed since the schema is empty and the description focuses on the tool's purpose and output.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: "Every sport and competition this API currently covers, with its sport_key." It uses the verb 'list' implicitly and identifies the exact resource (sports/competitions) and output field (sport_key), making it distinct from sibling tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicit guidance is provided: "Call this FIRST if you are unsure of the right sport_key" and "checking here is cheaper" than relying on a 404 from other tools. It also clarifies the alternative for racing (separate racing_* tools), giving clear when-to-use and when-not-to-use context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.