Server Quality Checklist

Tool Scores

• start_trackingB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, and the description only states the action without disclosing side effects (e.g., whether starting a new task stops an existing timer), permissions required, or return value behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Single sentence, front-loaded with the action, no wasted words or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Description is minimal; with no output schema, it does not mention what the tool returns or any behavioral effects. Sibling tools suggest a workflow but the description does not explain how this tool fits (e.g., whether it stops existing tracking).

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema has 100% coverage of parameter descriptions, so the description adds no additional parameter semantics. Baseline 3 is appropriate as the schema provides all necessary information.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Start tracking') and the resource ('time for a new task'), which is specific and distinguishes it from sibling tools like stop_tracking and show_current_time_entry.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance on when to use this tool versus alternatives; no mention of prerequisites or exclusions. The verb 'Start' implies usage but does not explicitly differentiate from siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• stop_trackingA
  3.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It does not disclose what happens if no time entry is running, whether the stopped entry is returned, or any side effects, leaving critical behavioral details unknown.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  A single, direct sentence that conveys the tool's entire purpose without any filler. Exceptionally concise and front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  While the tool is simple, the description omits edge-case behavior and return value information, especially since there is no output schema. It is minimally viable but leaves questions about error handling and response format.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters and the schema is fully covered (100%). Per the rubric, the baseline is 4 when there are no params, and the description adds no unnecessary param details.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Stop' and identifies the resource 'the currently running time entry', making it clear what the tool does. It clearly differs from sibling tools like start_tracking and show_current_time_entry.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The purpose implies usage—stopping an active time entry—and complements start_tracking and show_current_time_entry. However, there is no explicit when-to-use guidance or mention of alternatives, leaving the decision to the agent's inference.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_workspacesA
  3.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It only states the action without disclosing any behavioral traits such as read-only safety, required authentication, potential pagination, or the structure of the returned list. While a simple list operation implies no side effects, this is not explicitly conveyed, leaving some ambiguity.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence with no redundant information. It is appropriately front-loaded and every word adds value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given there are no parameters, no output schema, and no annotations, the description provides a complete enough overview for a simple list operation. It does not specify the return format or any caveats, but the core functionality is clearly conveyed. A small improvement would be mentioning the return structure, but it is not necessary for such a trivial tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so there is nothing for the description to add. Per the baseline for 0 params, a score of 4 is appropriate, as the schema already fully covers the (empty) parameter space.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific verb ('List') and resource ('workspaces'), clearly indicating the tool's function. It distinguishes from sibling tools (start_tracking, stop_tracking, show_current_time_entry) which are all time-tracking operations, making this the obvious choice for workspace enumeration.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when one needs to see available workspaces, but it does not explicitly state when to use this tool versus siblings. There is no mention of alternatives or exclusions, but the purpose is straightforward enough that it is easy to infer.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• show_current_time_entryA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the behavioral burden. The phrase 'if any' discloses that the tool handles the case of no running entry, which is a useful detail. However, it does not explicitly state that the operation is read-only or describe any side effects, though the verb 'Show' implies safety. This provides some but not rich behavioral transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence of eight words. It is front-loaded with the action and resource, and every word contributes meaning. There is no redundancy or unnecessary detail.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter tool with no output schema, the description fully explains the tool's behavior: it shows the currently running time entry, or explicitly handles the absence of one. Given the simplicity of the tool, this is sufficient for an agent to select and invoke it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, giving it a baseline score of 4. The description does not need to add parameter semantics because there are none to explain, and the schema's 100% coverage confirms this.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Show' and identifies a precise resource: 'the currently running time entry.' The qualifier 'if any' adds nuance. This clearly distinguishes it from sibling tools like start_tracking, stop_tracking, and list_workspaces, which serve different purposes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description states what the tool does but provides no guidance on when to use it versus alternatives. There is no mention of checking status before starting/stopping a timer, nor any exclusions or context for how it fits into a workflow. The usage is left entirely to inference.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.