Server Quality Checklist

Tool Scores

• search_by_skillB
  3.4/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must disclose behavior independently. It states what the tool searches (work experiences and projects) but omits critical behavioral details such as the return format (list of matches? snippets?), whether matching is fuzzy or exact, and whether the search scope is limited to a specific resume/document. The description does not adequately convey the tool's behavior beyond its basic purpose.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence that immediately states the tool's purpose. It is front-loaded with the action and resource, contains no fluff, and every word contributes to meaning. This is an example of compact, effective wording.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has one parameter, no output schema, and no annotations, the description should compensate by explaining what the results look like and the search behavior. It fails to mention whether the output is a list of experiences/projects, whether it includes context snippets, or if the search applies to the entire resume or a specific section. The description is too sparse to be considered complete for a search tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100% (the 'skill' parameter includes examples and a clear description). The tool description largely paraphrases the schema ('a given skill or technology') without adding new meaning. It does not clarify nuances like case sensitivity, partial matches, or how to pass multiple skills. Baseline 3 is appropriate because the schema already carries the semantic weight.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Find') and clearly identifies the resource ('work experiences and projects') and the criterion ('where a given skill or technology was used'). It effectively distinguishes from sibling tools like get_summary and get_section, which are about retrieving entire sections rather than searching by skill.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies its usage context: when you need to locate experiences/projects using a specific skill. However, it provides no explicit guidance on when not to use it or how it compares to alternative tools (e.g., get_section for broader overviews). The lack of explicit alternatives or exclusions places it at 'implied usage' rather than clear context with exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_summaryA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden of disclosing behavioral traits. The verb 'return' implies a safe read operation, but it does not explicitly state non-destructiveness, error handling, or any context-dependent behavior. This is basic transparency, though not misleading.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that states exactly what the tool returns. There is no fluff or unnecessary information, making it highly concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (no parameters, no output schema, read-only intent), the description fully covers what an agent needs to know: it returns the candidate's name, label, and professional summary. There is no missing essential context for a tool this straightforward.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, and the schema is fully covered (100% trivially). The description does not need to explain any parameters, and the baseline for zero-parameter tools is 4. The description adds no parameter details but is not expected to.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'return' and identifies the resource as 'the candidate's name, label, and professional summary'. This clearly distinguishes it from siblings like get_section and search_by_skill, which have different return types and purposes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It does not mention any conditions, exclusions, or alternative options, leaving the agent to infer usage from the name.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_sectionA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It correctly implies a read-only operation with no side effects, but it does not specify the return format or error behavior. Given the absence of an output schema, this leaves some ambiguity.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence that communicates the action and scope with no unnecessary words. It is optimally concise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter getter, the description adequately covers the core function and parameter values. The main gap is the lack of return format detail, especially since no output schema exists, but the tool's simplicity reduces the impact of this omission.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0%, and the description helps by listing the allowed enum values in prose, adding the context that these are sections 'of the resume.' However, it mostly restates the schema's enum and adds no additional detail about parameter semantics beyond that.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Return' with a clear resource 'one section of the resume' and enumerates the four possible sections. This immediately distinguishes it from sibling tools like get_summary and search_by_skill, which serve different retrieval purposes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly establishes the use case: fetching a specific named section (work, education, skills, projects). It does not explicitly mention alternatives like get_summary or search_by_skill, so it lacks a 'when not to use' statement, but the context is sufficiently clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.