Server Quality Checklist

Tool Scores

• approve_leaveC
  2.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden for behavioral disclosure. It mentions that the tool updates the balance, which is a side effect, but does not specify permissions required, reversibility, error conditions, or behavior for invalid or already-approved leaves.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence with no fluff, but it is too brief to convey necessary context. The structure is efficient, though the content is minimal and could be expanded to include important details.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given two required parameters, no output schema, and no annotations, this description is insufficient for a mutation tool. It does not explain the balance update mechanism, expected return values, or any prerequisites, leaving significant gaps for an agent to invoke it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, and the description does not explain the meaning or role of leaveId or studentId. The parameter names are self-explanatory in the schema, but the description adds no semantic value beyond the schema, failing to compensate for the low coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: approving a pending leave and updating the balance. It uses a specific verb ('approve') with a resource ('pending leave'), which distinguishes it from sibling tools that list or retrieve student information.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit guidance is provided on when to use this tool versus alternatives, nor are there any prerequisites or exclusions. The description implies usage for approving pending leaves but does not explain when to prefer this over list_students or get_student_details.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_student_detailsA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must fully disclose behavioral traits. It only states the happy-path return (student and leave requests) but does not mention error handling, whether all leave requests are included or only specific ones, or any authentication requirements. This leaves significant gaps in behavioral transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence (six words) that efficiently conveys the core function. It is front-loaded and contains no fluff, earning full marks for conciseness.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity and a well-described parameter schema, the description is partially complete. However, the lack of an output schema means the description should elaborate on the return shape (e.g., what fields are included in the student object and the leave requests), and it does not mention alternative tools or edge cases, so it falls short of full completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema fully documents the 'id' parameter with a clear description and example ('Student ID, e.g. S001'), and coverage is 100%. The description does not add extra semantic detail about the parameter beyond what the schema already provides, so it meets the baseline.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function with a specific verb ('Return') and resource ('one student and their leave requests'). It distinguishes itself from sibling tools like list_students (which lists multiple) and approve_leave (which modifies leave status). The title reinforces the 'by ID' aspect.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool should be used when fetching a single student's details, but it does not explicitly state when to use it versus alternatives. No exclusions or alternative tool mentions are provided, leaving usage guidance at an implied level.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_studentsA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of behavioral disclosure. It states the action ('Return all students') but does not clarify whether 'with remaining leave balance' filters the result set or simply includes the balance field. It also omits details on ordering, pagination, or response format, leaving room for misinterpretation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that immediately conveys the action and resource. It is concise, front-loaded with the verb 'Return,' and contains no wasteful phrasing, allowing an agent to parse it quickly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple, parameterless read tool, the description covers the core purpose but leaves a key ambiguity about whether 'with remaining leave balance' filters the returned students or is just an included attribute. With no output schema or annotations to clarify behavior, an agent may not know the exact response structure, so a mid-range score is warranted.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  This tool has zero parameters, so the input schema provides complete coverage (vacuously 100%). The description does not need to document parameter syntax, making the baseline of 4 appropriate. No additional parameter-related information is required.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'Return' and identifies the resource 'all students' with a qualifying phrase 'with remaining leave balance.' This clearly distinguishes it from sibling tools like get_student_details (likely a single-student lookup) and approve_leave (a mutation). Minor ambiguity exists about whether the qualifier filters students or includes a field, but the core purpose is unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It does not mention get_student_details for individual lookups or approve_leave for leave approvals, nor any exclusions or prerequisites. Agents must infer usage solely from the tool name.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.