Server Quality Checklist

Tool Scores

• send_notificationsC
  2.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are present, so the description bears full responsibility. It only states the basic action but fails to disclose important behavioral traits such as recipients, side effects, or permissions. This is insufficient for safe invocation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is very short, which is concise, but it under-specifies the tool. It lacks necessary detail, so it is not optimally concise—it sacrifices completeness for brevity.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the low complexity (2 string params), but with no annotations and no parameter descriptions, the description is incomplete. It does not explain the tool's purpose beyond the basics, ignoring important context like notification delivery mechanism or result.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, meaning no parameter descriptions exist. The description merely repeats the parameter names without adding meaning, constraints, or examples. It does not compensate for the schema's lack of detail.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action (send) and resource (notification) and mentions the key inputs (title and message). It is specific and unambiguous, although it does not explicitly differentiate from siblings (which are activity-related, so differentiation is inherent).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool, when not to use it, preconditions, or alternatives. The description offers no context for decision-making.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• update_activityC
  2.6/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the full burden. It only restates parameter names and defaults without disclosing side effects, destruction, permission requirements, or behavior on errors. 'Update' implies mutation, but no further behavioral context is given.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is front-loaded with the core action, but the parameter list is verbose and repeats schema defaults. Each sentence adds some value, but the overall length could be reduced by omitting obvious descriptions.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With 4 required parameters and an output schema, the description lacks completeness. It does not explain how current_step relates to activity state, what happens after update (e.g., side effects), or how the color impacts the UI. The output schema is present but the description does not reference it, leaving context incomplete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. However, it merely restates parameter names (e.g., 'The ID of the activity to update') without adding meaningful semantics. The color and current_step_color get a bit more context, but overall, the descriptions are shallow and not helpful beyond the parameter names.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states 'Update an activity' clearly, but the mention of 'title and message' is slightly misleading as it includes many other fields. It distinguishes the core action from siblings like start_activity or end_activity, but could be more specific about the resource being updated.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus the sibling tools (end_activity, send_notifications, start_activity). There is no mention of prerequisites, context, or exclusions, leaving the agent without decision support for tool selection.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• end_activityB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description must fully convey behavioral traits. It does not disclose side effects (e.g., whether ending is irreversible), permissions required, rate limits, or what happens to the activity afterwards. The description only states the action and lists parameters.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is structured as a docstring with parameter list, which is clear but somewhat repetitive (e.g., 'to show when the activity ends' appears multiple times). It could be more concise by grouping or removing redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the presence of an output schema and 7 parameters, the description covers parameter semantics but lacks details on return value, error handling, or lifecycle context. It is minimally complete for a simple mutative action.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds meaning to each parameter beyond the schema's property names, including brief explanations like 'The ID of the activity to end' and default values. With 0% schema description coverage, this is essential and well-handled, though some descriptions are slightly tautological.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action: 'End an activity with a title and message.' This is a specific verb+resource combination that distinguishes it from sibling tools like start_activity and update_activity.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives such as update_activity or send_notifications. It lacks context on prerequisites, timing, or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• start_activityA
  3.5/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations provided, and the description only describes the action without disclosing side effects, permissions, or behavior (e.g., whether it triggers notifications, other side effects).

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is structured as a docstring with a clear first sentence and parameter list. While somewhat verbose by repeating schema info, it is necessary because the schema lacks descriptions.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  All parameters are explained, but the description does not mention what the tool returns (output schema exists but not described) or behavioral context like whether it's blocking or part of a workflow.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds meaningful explanations for each parameter (e.g., 'title to show when the activity starts'), which is lacking in the input schema (0% coverage). It also notes defaults and optionality.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'Start' and the resource 'an activity', and it distinguishes from sibling tools (end_activity, update_activity, send_notifications) by implying this is for initiating, not ending or updating.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance on when to use this tool versus alternatives, no prerequisites or context for its invocation.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.