Server Quality Checklist

Tool Scores

• get_leave_historyC
  2.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the burden. It only states the purpose without disclosing behavioral traits such as read-only nature, response format, filtering, or pagination. Minimal disclosure of the operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with no redundant words, making it concise and front-loaded. However, it is somewhat under-specified, but for conciseness it earns high marks.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the existence of an output schema and one required parameter, the description is very incomplete. It does not explain expected return values, usage context, or any limitations. For a tool with no annotations, this is a significant gap.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%. The description adds no information about the employee_id parameter beyond what the schema shows. It would need to explain how to specify the employee, but it does not.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Get' and resource 'leave history', clearly indicating the tool's function. It distinguishes from siblings like get_leave_balance (balance vs history), though it lacks detail on scope.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance on when to use this tool versus alternatives. Does not mention conditions, prerequisites, or exclusion criteria.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_leave_balanceC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It does mention the action is to 'Check', implying a read-only operation, but it does not explicitly state whether authentication is required, what happens if the employee_id is invalid, or the format of the returned data. It also does not confirm there are no side effects, which is critical without annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence with no redundant words. It is front-loaded with the action and resource, making it easy to parse. This is appropriately sized for the tool's simplicity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with only one parameter and an output schema, so the description covers the core function. However, it misses usage context and does not explicitly frame it as a read-only operation. The absence of annotations and lack of comparison to siblings leaves gaps, but given the tool's simplicity, it is minimally viable.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0% and the description does not mention the employee_id parameter at all. The parameter name and type are self-explanatory, but the description adds no meaning about the expected format, whether it is an internal identifier, or any constraints. Given the low coverage, the description should compensate but fails to do so.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: checking remaining leave days for an employee. It uses a specific verb ('Check') and resource ('leave days'), which distinguishes it from generic operations. However, it does not explicitly compare against sibling tools like get_leave_history or apply_leave, so the differentiation is implied rather than stated.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  There is no guidance on when to use this tool versus alternatives. The description simply states what it does, but does not mention that it should be used for current balance checks, nor provide exclusions (e.g., for historical data use get_leave_history). This leaves the agent without clear decision-making context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• apply_leaveB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description provides no behavioral context beyond the action itself. It does not disclose side effects, whether approval is required, how conflicts are handled, or permissions needed. The only extra is the date array example.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with a concrete example, front-loaded with the verb, and contains no redundant information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a two-required-parameter mutation tool, the description omits the employee_id parameter entirely and gives no information about constraints or process. Although an output schema exists, the description does not fully compensate for the 0% schema description coverage.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%. The description adds meaning only to leave_dates via an example, but leaves employee_id entirely unexplained beyond its property name. No additional semantics for employee_id are provided.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('apply') and resource ('leave'), and the example clarifies the expected date array format. It is clearly distinct from the read-only siblings (get_leave_balance, get_leave_history).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for requesting time off but does not explicitly state when to use this versus the sibling getter tools, nor any prerequisites or exclusion criteria. The contrast is implicit through the tool name and sibling names.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.