Server Quality Checklist

Tool Scores

• get_latest_resultsB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It states the tool 'gets' results (implying read-only) but does not disclose idempotency, side effects, error conditions, or any other behavioral traits beyond the basic operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise, using a standard Python docstring format. It is front-loaded with the main purpose and clearly lists parameters. However, it could be slightly more succinct without the Args/Returns markers.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 2 parameters and no output schema, the description is somewhat incomplete. It explains parameters but the return value is vague ('最近几期的开奖结果'). For a tool with no output schema, more detail on result structure would improve completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so description must compensate. It adds meaning by specifying allowed values for lottery_type ('double_ball' or 'super_lotto') and explaining the default for count (5), which the schema does not provide.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool retrieves recent lottery results for specified types (double_ball, super_lotto) and count. It uses a specific verb ('获取' meaning 'get') and resource ('开奖结果' meaning 'results'), but does not distinguish from sibling tools like check_prize or query_lottery.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. The description lacks context on prerequisites, exclusions, or scenarios where sibling tools would be more appropriate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• update_lotteryB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Without annotations, the description discloses that the tool performs a write operation and returns counts, but fails to specify whether data is overwritten or appended, or any potential side effects like deletion of existing data. No authentication or rate limit info is given.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise, using bullet-like formatting in a docstring. It front-loads the purpose and includes parameter details efficiently, with no extraneous content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the absence of annotations and output schema, the description provides the core function and return summary, but lacks details on failure modes, idempotency, or precise return structure. It is adequate but leaves some important gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds value beyond the schema by enumerating allowed values for lottery_type ('double_ball', 'super_lotto') and specifying date format (YYYY-MM-DD) for start_date and end_date. However, it does not clarify whether end_date is inclusive or the exact behavior of the date range.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states it updates lottery draw data to the local database, using the verb 'update' and specifying the resource. However, it does not explicitly distinguish from sibling tools (e.g., query_lottery), though the write nature is implied.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool over alternatives. It does not mention prerequisites, context for use, or any restrictions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• query_lotteryA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description indicates a read-only query operation, which is accurate. However, with no annotations provided, it does not disclose any additional behavioral traits such as authentication requirements, rate limits, or data freshness. The description is functional but minimal.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise: one sentence for purpose, then structured Args and Returns sections. Every sentence is necessary and front-loaded with the core purpose. No redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description covers input parameters and basic purpose, but lacks details on output format (beyond 'list of results'), error handling, or edge cases. Given no output schema and no annotations, more behavioral context would improve completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Despite 0% schema description coverage, the description's Args section provides meaningful explanations for each parameter: lottery_type options ('double_ball' and 'super_lotto'), and date format (YYYY-MM-DD). This adds value beyond the schema's property titles alone.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states '查询指定日期范围内的开奖结果' (query lottery results within a specified date range), using a specific verb and resource. It implicitly distinguishes from siblings like get_latest_results (which gets only the latest) and check_prize (which checks a specific ticket).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when needing results for a date range, but does not explicitly exclude scenarios where alternatives like get_latest_results or check_prize might be more suitable. No when-not-to-use guidance is provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• check_prizeA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It states the tool checks and returns match details and prize levels, which implies read-only behavior. While it does not explicitly say it is non-destructive, the verb 'check' strongly implies no side effects. It could be more explicit but is adequate for an agent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and well-structured: one line for purpose, followed by clear Args and Returns sections. Every sentence provides necessary detail without redundancy. No fluff.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description covers all parameters and explains the return value (winning results with match details and prize level). It is complete for a moderately complex tool. It could be enhanced by mentioning default behavior or edge cases (e.g., what if no matches), but overall it provides sufficient context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0%, so the description must compensate. It thoroughly explains each parameter: lottery_type with two explicit options and their English/Chinese names, date format (YYYY-MM-DD), and numbers structure for both lottery types (red/blue ball ranges, positions). This adds significant meaning beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: checking winning status of specified lottery numbers within a date range. '检查指定号码在日期范围内的中奖情况' translates to 'Check the winning status of specified numbers within a date range'. It uses a specific verb ('check') and resource ('lottery numbers'), and the context of sibling tools (get_latest_results, query_lottery, update_lottery) indicates this tool is distinct in that it checks specific numbers for wins.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context ('to check winning status') but does not explicitly state when to use this tool versus alternatives, nor does it provide exclusions or prerequisites. It lacks guidance on when not to use it or which sibling tool to prefer in different scenarios.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.