Server Quality Checklist

Tool Scores

• get_leave_historyC
  2.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states 'Get leave history', implying a read-only operation, but doesn't specify if it requires authentication, returns paginated results, includes error handling, or has rate limits. For a tool with zero annotation coverage, this is a significant gap in transparency about how it behaves beyond the basic action.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, straightforward sentence: 'Get leave history for the employee'. It's front-loaded with the core action and resource, avoiding unnecessary words. However, it could be more structured by including key details like scope or usage, but as-is, it's efficiently concise without being under-specified.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity (one parameter) and the presence of an output schema (which likely covers return values), the description is minimally adequate. It states the basic purpose but lacks context on usage, parameters, and behavioral traits. With no annotations and low schema coverage, it doesn't fully compensate, but the output schema reduces the need to explain returns, keeping it at a baseline level.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has one parameter ('employee_id') with 0% schema description coverage, meaning the schema provides no details about its meaning or format. The description doesn't add any parameter semantics—it doesn't explain what 'employee_id' represents, its expected format (e.g., numeric, string), or validation rules. This fails to compensate for the low schema coverage, leaving the parameter poorly documented.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose3/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Get leave history for the employee' clearly states the action (get) and resource (leave history), making the basic purpose understandable. However, it lacks specificity about what 'leave history' includes (e.g., past requests, approvals, dates) and doesn't distinguish it from sibling tools like 'get_leave_balance', which might overlap in scope. It avoids tautology but remains somewhat vague.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. The description doesn't mention prerequisites, such as needing a valid employee ID, or contrast it with sibling tools like 'apply_leave' (for submitting requests) or 'get_leave_balance' (for current status). This leaves the agent without clear direction on appropriate contexts or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• apply_leaveC
  2.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden for behavioral disclosure. While 'Apply leave' implies a write/mutation operation, the description doesn't specify whether this requires approval, what permissions are needed, whether it's reversible, or what happens with conflicting dates. The example format is helpful but doesn't address critical behavioral aspects of a leave application system.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise - just one sentence with a helpful example. There's no wasted text, and the information is front-loaded. However, the brevity comes at the cost of completeness, making it more under-specified than optimally concise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given this is a mutation tool with no annotations, 2 parameters (0% schema coverage), but with an output schema present, the description is minimally adequate. The example format helps, but critical context is missing: no error conditions, no relationship to sibling tools, no behavioral constraints. The output schema existence means return values are documented elsewhere, but the description should still address more operational context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description provides an example format for 'leave_dates' parameter (array of date strings), which adds meaningful context beyond the schema's 0% description coverage. However, it doesn't explain the 'employee_id' parameter at all, nor does it clarify date format requirements, validation rules, or what constitutes valid leave dates. The schema coverage is 0%, so the description partially compensates but not fully.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose3/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states the tool's purpose ('Apply leave for specific dates') which is a clear verb+resource combination. However, it doesn't distinguish this from potential sibling tools like 'get_leave_balance' or 'get_leave_history' - it only describes what it does without contextual differentiation. The example dates help illustrate the format but don't enhance the core purpose statement.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. There's no mention of prerequisites, constraints, or relationships with sibling tools like 'get_leave_balance' (which might be needed before applying leave) or 'get_leave_history' (which might show past applications). The agent receives no help in determining appropriate usage contexts.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_leave_balanceB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It implies a read-only operation ('check'), but doesn't specify if it requires authentication, has rate limits, returns data in a specific format, or handles errors. This is a significant gap for a tool with no annotation coverage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core purpose without unnecessary words. Every part earns its place by clearly stating what the tool does, making it highly concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity (one parameter) and the presence of an output schema (which handles return values), the description is minimally adequate. However, it lacks context on usage versus siblings and behavioral details, making it incomplete for optimal agent guidance without additional structured data.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 0%, but the description mentions 'for the employee', which hints at the 'employee_id' parameter's purpose. However, it doesn't add details like format or constraints beyond what's implied. With one parameter and low coverage, this provides minimal compensation, aligning with the baseline.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('check') and resource ('leave days left for the employee'), making the tool's purpose immediately understandable. However, it doesn't explicitly differentiate from sibling tools like 'get_leave_history' which might also involve checking leave information, so it misses the highest score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like 'get_leave_history' or 'apply_leave'. It lacks context about prerequisites, such as needing an employee ID, or any exclusions, leaving the agent to infer usage from the tool name alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.