Server Quality Checklist

Tool Scores

• wick_summaryB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral transparency. The term 'summary' implies a read-only aggregate, but the description does not disclose what data is included, how it is computed, or whether the operation might be expensive. It also doesn't indicate what happens if no sessions exist or what output shape to expect.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single concise sentence of seven words: 'All-time usage summary across every Wick session.' It is front-loaded with the core purpose and contains no filler, redundant phrases, or irrelevant details. Every word contributes meaning.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple (no parameters, no output schema), but the description remains vague about what the summary includes. It mentions 'usage' and 'every Wick session' but does not specify metrics (e.g., hours, events, categories) or whether the output is a single number, a breakdown, or a report. This is a notable gap for a tool that could benefit from a sentence clarifying its output structure.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema is an empty object with zero parameters, so there are no parameter semantics to clarify. Per the scoring guidelines, a description with no parameters receives a baseline of 4, and the description does not need to compensate for any undocumented parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies the tool as an 'All-time usage summary across every Wick session,' indicating it aggregates usage data from all sessions. It lacks an explicit verb like 'get' or 'retrieve,' but the noun phrase 'summary' implies a read operation. It distinguishes from siblings like wick_status or wick_track by emphasizing 'all-time' and 'every session.'

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like wick_status or wick_export. It does not mention use cases, prerequisites, or exclusions. For example, it doesn't clarify whether wick_summary is the right choice for checking current status versus a historical overview.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• wick_resetA
  3.9/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It states the core action ('Reset the session counter') and one behavioral trigger (rate limit reset), but does not disclose side effects, reversibility, or what exactly 'reset' entails beyond the name. This is minimal but not misleading.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the purpose, and contains no redundant wording. Every sentence earns its place: the first states the action, the second gives usage guidance.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with zero parameters, no annotations, and no output schema, the description adequately covers the essential aspects: what it does and when to use it. It could be slightly richer (e.g., clarifying that it resets to zero or any side effects), but it is sufficient for a simple reset operation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has zero parameters, so per the baseline rule for 0 params, a score of 4 is appropriate. The description does not need to explain parameter semantics since there are none.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action: 'Reset the session counter.' It is a specific verb+resource pairing. However, it does not explicitly differentiate from sibling tools like wick_track or wick_status, though the reset action is distinct.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives explicit usage context: 'Use when starting a new task or after a rate limit reset.' This provides clear guidance on when to invoke the tool, but it does not mention alternatives or when not to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• wick_exportA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. However, 'export' implies a read-only operation, and the description does not mention any side effects or additional behaviors. It adds no explicit safety or auth context, which is acceptable for a simple export but still leaves ambiguity about the exact behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, focused sentence with no filler. It front-loads the action and resource, then lists formats, achieving high information density.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with one optional parameter and no output schema. The description adequately covers what the tool does and the formats available. It lacks details about the return mechanism or any caveats, but given the simplicity, it's close to complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has one optional parameter 'format' with enum values, but the schema description coverage is 0%. The description compensates by explicitly listing 'JSON, CSV, or a Markdown table', which restates the enum in natural language and clarifies the meaning. It adds value beyond the raw schema, though it doesn't detail each format's nuances.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Export' and resource 'session data', listing three concrete output formats. This clearly distinguishes it from sibling tools like wick_track or wick_status, which have different purposes.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when a user needs to export session data, but it does not provide explicit guidance on when to choose this tool over alternatives or mention any exclusions. Sibling tools are not referenced, so the agent must infer the appropriate context based on the tool name and purpose alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• wick_trackA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of explaining behavior. It states what the tool does and its downstream effect (computing burn rate, session cost, estimated messages remaining), which is useful. However, it does not disclose side effects, idempotency, or error behavior, leaving some gaps for a tool that likely records data.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences long, front-loaded with the core action, and each sentence adds value: purpose, when to call, and why it matters. There is no redundancy or fluff, making it highly concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple tracking tool with no output schema, the description covers the what, when, and why effectively. It explains the tool's role in the broader lifecycle (after every response) and the metrics it powers, which is sufficient for an agent to invoke it correctly. Minor omissions like error handling or exact return values are not critical here.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all five parameters. The description adds minimal extra meaning beyond linking the parameters to 'this response', which is implicit. Baseline 3 is correct since the description does not need to compensate for schema gaps.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Track token usage for this response' with a specific verb and resource, and it explicitly scopes the action to the current response. It effectively distinguishes this from sibling tools like wick_status and wick_reset by focusing on per-response token tracking.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives an explicit trigger: 'Call this after EVERY Claude response automatically.' This is a clear when-to-use instruction. It does not mention alternatives or exclusions, but the mandatory nature of the call is unambiguous, so a 4 is appropriate.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• wick_statusA
  4.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description bears the full burden of behavioral disclosure. It discloses the type of information returned (tokens, cost, burn rate, messages left) but does not explicitly state that the operation is read-only or side-effect-free, nor does it mention any potential implications like cost or rate limits. The verb 'Get' implies retrieval, but an explicit statement would be clearer.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, well-structured sentence. It front-loads the core purpose ('Get your current Claude session stats') and then efficiently lists the included data points. Every word adds value, with no redundancy or extraneous information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (no parameters, no output schema), the description sufficiently covers the necessary context. It clearly states what the tool returns, including specific cost currencies and the messages-left estimate, which is enough for an agent to understand the tool's function and invoke it correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters, and the schema is an empty object with 100% coverage. According to the rubric, a 0-parameter tool gets a baseline of 4. The description adds no parameter-specific information because there are none, which is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Get' and a clear resource ('your current Claude session stats'), explicitly listing the metrics returned (tokens used, cost in USD and INR, burn rate, messages left estimate). This clearly distinguishes it from siblings like wick_summary (which likely provides summaries) and wick_track (which may track history).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool is for checking current session statistics, and the word 'current' provides some context. However, it does not explicitly state when to use this tool versus alternatives like wick_summary or wick_track, nor does it mention exclusions. This is a clear context but lacks explicit usage guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.