Server Quality Checklist

Tool Scores

• list_tracked_emailsC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It mentions 'recent' and 'open status', but doesn't clarify what 'recent' means (e.g., time range), whether results are paginated, if authentication is required, or any rate limits. For a read operation with zero annotation coverage, this leaves significant gaps in understanding the tool's behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence: 'List recent tracked emails with their open status.' It's front-loaded with the core action and resource, with no wasted words. Every part of the sentence contributes meaning, making it highly concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity (a read operation with one parameter) and lack of annotations or output schema, the description is incomplete. It doesn't explain what 'recent' entails, the format of returned emails, or any behavioral traits like pagination. For a tool that lists data, more context is needed to fully understand its usage and output.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, with the parameter 'limit' fully documented in the input schema (type, default, max). The description doesn't add any parameter-specific information beyond what the schema provides, such as clarifying 'recent' as a parameter. Since the schema does the heavy lifting, the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'List recent tracked emails with their open status.' It specifies the verb ('List'), resource ('tracked emails'), and scope ('recent'), distinguishing it from siblings like 'check_tracking_status' (likely for a single email) and 'send_tracked_email' (a write operation). However, it doesn't explicitly differentiate from siblings beyond the verb, so it's not a perfect 5.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention siblings like 'check_tracking_status' or 'send_tracked_email', nor does it specify prerequisites, such as needing tracked emails to exist. The context is implied ('recent'), but no explicit usage rules are given.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• send_tracked_emailA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It adds useful context such as 'read tracking', 'body accepts markdown (converted to HTML automatically)', and 'sent immediately via Gmail API', which go beyond basic functionality. However, it does not cover aspects like error handling, rate limits, or authentication requirements, leaving some behavioral traits unspecified.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is appropriately sized and front-loaded, with two sentences that efficiently convey key information: the tool's purpose and its main features (tracking, markdown conversion, immediate sending). Every sentence adds value without redundancy, making it concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (a mutation tool with no annotations and no output schema), the description is fairly complete. It covers the core functionality, key features, and behavioral aspects like tracking and sending method. However, it lacks details on error handling, return values, or prerequisites, which could be important for a mutation tool. The absence of an output schema means the description should ideally explain what is returned, but it does not, leaving a minor gap.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all parameters thoroughly. The description adds minimal value beyond the schema by mentioning markdown conversion for the body and the immediate sending via Gmail API, but does not provide additional semantics for parameters like 'to', 'subject', or 'cc/bcc'. Baseline 3 is appropriate as the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with specific verbs ('send an email') and resources ('via Gmail'), and distinguishes it from sibling tools by specifying 'with read tracking' (unlike check_tracking_status or list_tracked_emails). It explicitly mentions the action and the unique feature of tracking.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by stating 'send an email with read tracking' and 'sent immediately via Gmail API', but does not explicitly state when to use this tool versus alternatives like check_tracking_status or list_tracked_emails. It provides some guidance on the tool's function but lacks explicit comparisons or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• check_tracking_statusA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden. It discloses the return data (open count, device info, timestamps) which is valuable behavioral information, but doesn't mention potential limitations like rate limits, authentication requirements, or error conditions. It adds some context but leaves gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences with zero waste - first states the purpose, second describes the return values. Perfectly front-loaded and appropriately sized for this simple tool.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a single-parameter query tool with no output schema, the description provides good coverage of purpose and return values. However, without annotations or output schema, it could benefit from more behavioral context about limitations or error handling. It's mostly complete but has minor gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already fully documents the single parameter. The description adds no additional parameter information beyond what's in the schema. Baseline 3 is appropriate when the schema does all the parameter documentation work.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('check if a tracked email has been opened'), identifies the resource ('tracked email'), and distinguishes from siblings by focusing on status checking rather than listing or sending emails. It provides a complete verb+resource+outcome statement.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by mentioning 'tracking ID returned from send_tracked_email' (referencing a sibling tool), but doesn't explicitly state when to use this tool versus alternatives like list_tracked_emails. It provides clear context but lacks explicit when/when-not guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.