Server Quality Checklist

Tool Scores

• search_by_extensionB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It only mentions the search capability without disclosing whether searches are recursive, how results are ordered, any default limits beyond the schema's maxResults, or that it is a read-only operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences and front-loaded with the core functionality. The second sentence, 'Fast way to find all files of a certain type,' is slightly redundant but does not significantly waste space.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With no annotations and no output schema, the description should clarify the return format (e.g., file paths), recursion behavior, and the relationship between type='custom' and customExtensions. These practical details are absent, leaving the agent to infer critical execution context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema descriptions cover 100% of the 5 parameters, so the baseline is 3. The description adds context by enumerating type categories and mentioning custom extensions, but it doesn't add meaning for path, pattern, or maxResults beyond what the schema already provides.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states it searches for files by type category or custom extensions, distinguishing it from sibling tools that filter by recency, size, or path. The verb 'search' and resource 'files' are specific, making the purpose unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'Fast way to find all files of a certain type' implies usage for finding files by type, but it does not explicitly state when to prefer this tool over sibling tools like search_files or search_in_path, nor does it mention any exclusions or alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_recentA
  3.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must disclose behavioral traits itself. It mentions performance but does not state that this is a read-only operation, what output format is returned, or any limitations like symlink handling. The non-destructive nature is implied but not explicit.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences that front-load the purpose and add a performance note. Every word earns its place with no filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with inputs fully documented, but there is no output schema, and the description does not mention what the results look like (e.g., file paths). This leaves some ambiguity about the return value, but the core behavior is understandable.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema covers all 4 parameters with descriptions at 100% coverage, so the schema does the heavy lifting. The description adds nothing beyond the 'N hours' concept, staying at the baseline 3 for full schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb+resource+qualifier: 'Find files modified within the last N hours.' This clearly distinguishes it from sibling tools that search by content or path. The focus on recency is explicit.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  States this is the fastest way to find recently changed files and directly compares to 'find -mtime' as a slower alternative, providing clear context for when to use it. However, it does not explicitly mention when to use sibling search tools or provide exclusionary guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_filesA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden of disclosing behavioral traits. It adds useful context about speed and the underlying Everything Search engine, but it does not disclose output format, default sorting, hidden file handling, or other behaviors that an agent might need to know.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise, front-loaded with the primary purpose, and every sentence earns its place. It avoids fluff and is well-structured for quick parsing.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has 6 parameters and no output schema, the description is minimally adequate. The schema covers parameters well, but the description does not explain what the tool returns (e.g., list of paths, count, etc.), leaving some ambiguity for an agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so parameters are fully documented. The description mentions wildcards and regex, which are already covered in the pattern parameter description, adding little extra semantic value beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool searches for files and folders by name pattern, using a specific verb and resource. It also specifies the underlying engine (Everything Search) and distinguishes itself from common alternatives like find, ls, and Glob, though not from its sibling tools directly.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly recommends using this tool over find, ls, or Glob for faster results, providing clear usage context. However, it does not mention when to use sibling tools like search_recent or search_by_extension, so it lacks explicit exclusions among alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_in_pathA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden. It mentions 'much faster than recursive directory scans' as a behavioral trait, but omits details like default recursion (true), result limits (50), or any permissions/side effects. Basic search behavior is implied, but not richly disclosed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences with no filler. The main purpose is front-loaded, and the second sentence adds a usage cue and performance benefit. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple search tool with 4 parameters and no output schema, the description is reasonably complete. It covers the core use case and differentiates from siblings. Missing explicit guidance on when not to use (e.g., vs search_by_extension) but overall sufficient for the tool's complexity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Input schema covers 100% of parameters with descriptions, so baseline is 3. The tool description adds no extra semantic detail beyond the schema, such as pattern syntax or edge cases. It neither enhances nor detracts from parameter understanding.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'Search for files within a specific directory.' It uses a specific verb ('search') and resource ('files within a directory'). It also distinguishes from siblings by emphasizing directory-scoped search and speed advantage over recursive scans.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says 'Use this to limit search scope to a particular folder,' providing clear when-to-use context. It implies alternatives exist (e.g., other search tools) but does not name them or state when not to use. Still, the usage cue is actionable.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_largeA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It adds useful context that results are 'sorted by size (largest first),' but it does not disclose whether the search is recursive, whether directories are included, or the exact return format. This leaves some behavioral ambiguity.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two concise sentences that front-load the core purpose ('Find the largest files in a directory') followed by a practical use case and a key behavioral detail (sorting). Every sentence adds value with zero redundancy or irrelevant filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity, the description is mostly complete: it states what it does, the sorting behavior, and the primary use case. However, it omits information about recursion depth or output format, and there is no output schema to compensate. Minor gaps remain, but the description is adequate for typical use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already provides 100% description coverage for all three parameters (path, minSizeMB, maxResults), including defaults and meanings. The tool description itself adds no additional parameter semantics beyond what the schema states, so it meets the baseline without going further.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's primary function: 'Find the largest files in a directory.' It uses a specific verb and resource, and the follow-up about sorting by size distinguishes it from sibling search tools that target by name, recency, extension, or path. This makes the purpose unmistakable.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear use context: 'Useful for finding files that take up the most space.' This implies when to use it (e.g., disk cleanup). However, it does not explicitly mention when not to use it or contrast it with specific sibling tools, so it falls short of full alternative guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.