Server Quality Checklist

Tool Scores

• audit_inventoryA
  3.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint and idempotentHint, and the description adds value by stating that the operation is simulated, time-consuming, and reports progress incrementally. This is consistent with the annotations and gives the agent a clear sense of runtime and output behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single efficient sentence that states what the tool does and its key behavioral trait. No filler or redundant information is present.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With an output schema, annotations, and a single self-explanatory parameter, the description is mostly sufficient for a simple simulation tool. However, it omits explicit guidance on how the progress reporting is delivered and when an agent should choose this tool over siblings.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0% and the description does not explicitly explain delay_seconds. However, the phrase '耗时盘点' implies the delay parameter controls simulated duration, and the parameter name plus default value make its purpose reasonably inferable.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('simulate') and resource ('inventory count'), and adds the distinct behavior of reporting progress step by step. This clearly separates audit_inventory from the book-focused siblings search_books, checkout_book, and return_book.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool is for simulating an inventory audit, but it does not state when to use it versus alternatives, nor does it mention any exclusions or preconditions. An agent must infer usage context from the word 'simulate'.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• return_bookA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare idempotentHint=true and destructiveHint=false, and the description restates idempotency ('重复调用结果不变') without adding new behavioral context such as side effects on book availability, permissions required, or error behavior. The description does not contradict annotations, but it also does not enrich the safety profile beyond what structured data provides.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence with no filler. It front-loads the core action ('根据借阅单归还图书') and appends the idempotency note, which is directly relevant. Every word contributes meaning.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter tool with output schema and annotations covering idempotency and non-destructiveness, the description is mostly sufficient. It lacks explicit mention of error cases or prerequisites (e.g., loan must exist and be active), but the simplicity of the tool and the supporting structured data make it reasonably complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema provides only the bare parameter name loan_id with no description, and schema description coverage is 0%. The description's '借阅单' (loan slip) gives a hint that loan_id references a loan slip, adding a small amount of meaning beyond the schema. However, it does not explain the format, where to obtain it, or how it relates to the returned book, leaving the agent partially in the dark.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb (归还/return) and resource (图书/book), and clarifies the basis (借阅单/loan slip). It clearly distinguishes itself from sibling tools like checkout_book by representing the inverse operation, and from search_books and audit_inventory which do not mutate loans.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Usage context is implied: a book is returned after being checked out, using the loan slip. However, there is no explicit guidance about when to use this tool versus alternatives, nor any mention of prerequisites such as the loan being active or already returned. The route to the right tool is obvious from the name and description but not spelled out.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• checkout_bookA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already indicate this is a non-read-only, non-destructive mutation. The description adds a meaningful behavioral guardrail—user confirmation is mandatory before execution—which is not available from annotations or schema alone. It does not detail side effects like inventory changes, but the availability wording partially implies them.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single compact sentence with the action stated first and the confirmation requirement after. No filler, repetition, or unnecessary detail.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple two-parameter checkout tool with an output schema and annotations, the description is nearly complete. It could be improved by stating what happens if the book is unavailable or how confirmation is elicited, but these are not essential for basic invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description does not explicitly explain the roles of book_id and member_id. However, the parameter names are self-explanatory, and 'available book' implies book_id should refer to a borrowable copy, so there is minimal but useful implicit guidance.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific action, '借阅' (checkout), with a clear resource, '一本可用图书' (an available book), which distinguishes it from sibling tools like return_book, search_books, and audit_inventory. It also adds a condition beyond the title: the book must be available.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives a clear execution context: borrow an available book, and user confirmation is required before execution. It does not explicitly name alternatives or when-not-to-use cases, but the domain and sibling tool names make the intended usage reasonably clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_booksA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint=true and idempotentHint=true, so the safety profile is covered. The description adds meaningful behavioral context by specifying that the search operates on title, author, or tag fields, which goes beyond the schema's simple 'query' string. It does not disclose pagination or result ordering, but this is minor for a simple search tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, compact sentence that delivers the essential information immediately. Every word earns its place and there is no redundant or filler content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple two-parameter search tool with an output schema and safety-revealing annotations, the description provides sufficient context to call the tool correctly. The search criteria are specified, required parameters are evident from the schema, and the output schema covers return values. Nothing critical is missing.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate for the underspecified 'query' parameter. It does so by clarifying that query can be a title, author, or tag. However, it does not explain the 'limit' parameter at all; although the default value provides some hint, the description leaves that semantic gap open.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('search') with a clear resource ('book catalog/bibliography') and explicitly lists the searchable criteria (title, author, or tag). This makes it easily distinguishable from the sibling tools, which are mutations or inventory audits.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly implies this tool is for finding books by title, author, or tag, which sets context against the mutation siblings (checkout_book, return_book). It does not explicitly state when not to use it or provide alternative selection criteria, but the sibling names make the distinction obvious enough.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.