Server Quality Checklist

Tool Scores

• get_personal_notesC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, so the description must carry the behavioral burden. It only says content is 'aggregated' and 'returned,' with no mention of authentication, ownership of the notes, side effects, error cases, or what 'aggregated' actually means. This is minimal disclosure, though not contradictory.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single short sentence with no filler, front-loading the action and core content type. The awkward 'personal-notes/' token is slightly unconventional, but the overall structure is efficient and scannable.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a one-parameter read-only tool with an output schema, the description covers the essential purpose and scope. It is still somewhat incomplete because it offers no usage context, no parameter detail, and no clarity about what 'aggregated' means in practice, leaving it only minimally adequate for autonomous invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the schema only provides the parameter name 'slug.' The description adds some value by tying the tool to 'one book,' implying that slug identifies a book. However, it does not explicitly describe the slug format, how to obtain it, or whether it refers to a book slug vs. a note identifier.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description names an action ('Return'), a resource ('aggregated personal-notes/ content'), and a scope ('for one book'). This is specific enough to distinguish it from siblings like get_book_metadata and get_chapter_summary, though it does not explicitly name any alternative.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  There is no guidance on when to use this tool versus related tools such as get_chapter_summary, get_action_items, or get_book_metadata. The phrase 'for one book' narrows scope, but it does not explain what makes this tool the right choice for personal-notes retrieval.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_action_itemsB
  3.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, so the description carries the behavioral burden. It accurately discloses a read action returning file contents and 'action-items.md' signals markdown format. However, it does not mention behavior for missing files, invalid slugs, or whether the returned content is raw markdown or structured output.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single short sentence with no filler. It front-loads the essential action and scope immediately, making it easy for an agent to parse quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a one-parameter read tool with an output schema, the description is minimally viable. The core action is clear, but missing slug semantics and lack of sibling differentiation leave some inference required. It is not fully complete, but it is not severely deficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0% and slug has no schema description. The description's 'for one book' implies that slug identifies the book, but it never explicitly names the parameter or explains how to obtain a valid slug, such as from list_books. This is partial compensation at best.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states a specific verb-resource pair: returning the contents of action-items.md for one book. It distinguishes itself by naming a distinct file resource, though it does not explicitly contrast with siblings like get_personal_notes or get_book_metadata.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  There is no guidance about when to use this tool versus siblings such as get_personal_notes or get_chapter_summary. The phrase 'for one book' implies a per-book scope, but no alternatives, exclusions, or decision rules are provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_book_metadataB
  3.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the behavioral disclosure burden. It clearly indicates the tool is a read operation that returns a metadata file, which covers the basic behavior. It does not mention potential errors, required permissions, or output formatting details, but for a simple retrieval tool the stated behavior is reasonably transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that is clear, direct, and free of filler. Every word contributes meaning, and it is appropriately sized for the tool's simplicity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a low-complexity tool with one required parameter and no output schema, the description gives the essential action and result. However, it does not explain the expected return format in detail or specify that the slug should come from a source like list_books, leaving minor but relevant context gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate for parameter meaning, but it does not explain that the slug is the book identifier or how to obtain it. The only hint is the phrase 'for one book,' which is weak and leaves the agent to infer that the slug parameter selects that book.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific action ('Return') and a specific resource ('the full metadata.yaml for one book'), making the purpose clear. It is distinct from siblings like list_books or get_chapter_summary by mentioning 'metadata.yaml', but it does not explicitly differentiate itself from sibling tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use this tool: when you need the full metadata YAML for a single book. However, it offers no explicit guidance about when not to use it or which alternative to choose, leaving usage context to inference.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_chapter_summaryB
  3.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry safety and behavior information. It transparently indicates a read-only operation by saying 'Return the markdown' and reveals the file-based source. It does not cover edge cases like missing chapters or auth requirements, but for a simple getter the core behavior is disclosed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that states the action first and includes no filler. The inline code formatting for the file path is compact and relevant. It is an example of appropriately concise writing, even if terse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given two simple string parameters and an output schema, the description is close to adequate but still leaves the meaning and format of `slug` and `chapter` underspecified. It also provides no guidance on error behavior or how to discover valid chapter identifiers. The existence of an output schema lessens the need to describe return values.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage, the description is the only source of parameter meaning. It clarifies that `chapter` becomes a path component and that the tool targets 'one book,' implicitly tying `slug` to the book, but it never defines `slug` explicitly or provides the expected `chapter` format. This leaves the agent guessing about valid values.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Return') and identifies the exact resource: the markdown for `chapter-summaries/<chapter>.md` scoped to one book. This makes it distinct from the sibling tools, which cover book search, metadata, action items, notes, and infographics. The only slight weakness is the internal file-path phrasing rather than a plainer statement of 'chapter summary content.'

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool should be used when the agent needs a specific chapter's markdown summary for a particular book. It does not explicitly state when to prefer this over list_books, get_book_metadata, or get_action_items, nor does it name alternatives or exclusions. Guidance is therefore present only by inference.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_booksA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It adds useful behavioral context by specifying that search spans all book content and that results include line context, which goes beyond the bare operation name. However, it does not disclose behavior around result limits, ordering, matching semantics (exact vs fuzzy, case sensitivity), or what happens with no matches — gaps that matter for a search tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two short sentences with zero filler: the first states the action and scope, the second states the return value. For a single-parameter tool, the description is appropriately sized and front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a low-complexity single-parameter tool, the description covers the core semantics: what it does, the scope of the search, and the shape of the result. Because an output schema exists, the return values need not be fully enumerated in prose. The only notable omissions are behavioral details like result limits and match semantics, which are minor given the tool's simplicity and the presence of an output schema.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate for the undocumented 'query' parameter. It implicitly defines the parameter by situating it within 'full-text search across all book content,' which is enough to infer that query is the search text. It does not, however, clarify accepted formats such as phrases, multiple terms, or search operators, so the parameter meaning is adequate but not fully specified.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('full-text search') with a precise resource ('all book content') and states the return shape ('slug + line context'). The operation is self-evidently distinct from every sibling, none of which perform content search — list_books, metadata, summaries, and notes are all retrieval or aggregation rather than full-text search.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use the tool: whenever an agent needs to find text within book content rather than list or inspect books. However, there is no explicit when-to-use guidance, no exclusions, and no explicit contrast with siblings such as 'use list_books to enumerate available titles instead,' leaving the routing decision to inference.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_booksA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description must carry behavioral disclosure on its own. It clearly states the operation is a read-only listing of all books and specifies the returned fields, which is adequate for a simple 0-parameter tool. It does not mention ordering, pagination, or auth, but these are not critical for such a straightforward listing.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single efficient sentence that front-loads the action and resource, then lists the output fields. Every word contributes value and there is no redundant or filler content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter listing with an output schema available, the description covers the core action and result fields sufficiently. It could be slightly more complete by pointing to search_books for filtered lookup, but that is not essential for correct invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and the schema coverage is 100%, so the description has no parameter semantics to add. Per the baseline for 0-parameter tools, this is appropriately handled by the schema and description.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb, 'List', with a clear resource, 'all books in the library', and even names the returned fields: slug, title, author. This makes its purpose unmistakable and separates it from the sibling search/get tools, which focus on narrower or different operations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives no explicit guidance on when to use list_books versus alternatives such as search_books or get_book_metadata. The phrase 'all books' implies a broad listing rather than a search, but no when-to-use or exclusions are stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_book_infographic_textA
  4.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It usefully reveals fallback behavior between chatgpt and gemini variants, but it does not state what happens if neither variant exists, nor any other runtime behavior or limitations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is compact, front-loaded with the primary function, and contains no filler. Every sentence adds necessary detail about file naming, valid source values, or fallback behavior.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple two-parameter getter, the description covers the essential behavior: what is returned, how the filename is composed, source options, and fallback logic. The presence of an output schema means return-value details do not need to be in the description.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must explain parameters. It does so by placing them in the filename template and explaining that `source` is either `chatgpt` or `gemini` with a default. This adds meaningful semantics beyond the bare schema property names.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns the contents of a specific file pattern (`<slug>_book_infographic_<source>.txt`), making the resource and action unambiguous. It also differentiates from sibling tools by focusing on infographic text rather than metadata, summaries, action items, or notes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives solid guidance for the `source` parameter, including valid values and fallback behavior. However, it does not explicitly explain when to choose this tool over siblings like get_book_metadata or get_chapter_summary, so tool-selection guidance is only implied.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.