Server Quality Checklist

Tool Scores

• list_eligible_occupationsA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It transparently discloses that the codes are placeholder slugs, not official Treasury codes, and that the output is informational. However, it could be more explicit about the exact return format, and the phrase 'plus the placeholder-slug caveat' is slightly ambiguous.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is front-loaded with the main purpose and followed by necessary caveats. It is not overly long, but the disclaimer is somewhat wordy, and 'plus the placeholder-slug caveat' is an awkward construction that reduces readability.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a parameterless list tool with no output schema, the description covers the core behavior, limitations, and applicability. It could be clearer about the exact return type (e.g., an array of occupation code strings) and what 'plus the placeholder-slug caveat' means, but it is generally complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema shows zero parameters with full coverage (properties: {}), so the description naturally needs no parameter explanations. The baseline for a zero-parameter tool is 4, and the description adds no unnecessary detail.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states it 'Returns the onboarding picker subset of TTOC-eligible occupations' with a specific verb and resource. However, it does not explicitly distinguish this from sibling tools such as check_tip_deduction_eligibility or estimate_tip_deduction, so it falls short of a 5.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context and boundaries: it's informational only, not tax advice, applies to tax years 2025-2028, and instructs users to verify with the IRS. This implies when to use the tool and cautions against using it for official tax decisions, but it does not explicitly name alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• estimate_tip_deductionA
  4.4/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description fully discloses behavioral traits: gating logic, zero output with reason_if_zero for ineligible cases, integer cents math, placeholder occupation codes, informational only status, and tax year limitations. It even mentions the specific Federal Register citation, leaving little unknown about the tool's behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is long but every sentence carries important information: gating, outputs, currency handling, placeholder caveat, disclaimer, and tax years. It is front-loaded with the main purpose and could benefit from paragraph breaks, but no sentence is wasted.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema and no annotations, the description is exceptionally complete. It lists all return fields, explains the gating factors, specifies applicable tax years, and adds verification guidance. For a complex financial calculation tool, this leaves no critical gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so baseline is 3. The description adds meaningful context beyond schema: 'Inputs/outputs in US dollars; internal math in integer cents' clarifies value formats, and the explicit warning that occupation codes are descriptive placeholders not official IRS codes adds critical nuance for that parameter.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states 'Estimates the OBBBA No-Tax-on-Tips deduction' with a specific verb and resource. It also distinguishes itself from siblings by focusing on the estimation function and explicitly mentioning gating factors that affect the estimate.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context about when the estimate applies (gated on occupation eligibility, sunset window, MAGI phase-out) but does not explicitly mention alternatives or when not to use this tool. Sibling tools like check_tip_deduction_eligibility are implied but not named, leaving usage guidance at an implied level.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_obbba_referenceA
  4.5/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of disclosure. It clearly states that the data is informational only, not tax advice, and that occupation codes are descriptive placeholders rather than validated numeric codes. It also specifies the applicable tax years (2025-2028), providing transparency about the tool's limitations and scope.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is three sentences, each adding distinct value: the main purpose, the disclaimer/verification note, and important caveats about occupation codes and tax-year scope. It is front-loaded and contains no filler or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter, no-output-schema tool, the description provides the key context: what data is returned, its limitations, and its validity period. It adequately informs the agent about the tool's scope and cautions against misuse, making it complete enough for reliable selection and invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has zero parameters, so the baseline is 4. The description adds no parameter-specific information (there are none), but it does enrich understanding by describing the output contents. This aligns with the baseline expectation for a no-parameter tool.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description begins with 'Returns the full OBBBA reference data' which clearly identifies the verb and resource, then lists specific contents (caps, phase-out bands, sunset window, module version, source URLs). This distinguishes it from siblings like check_tip_deduction_eligibility, estimate_tip_deduction, and list_eligible_occupations, which focus on other tasks.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for retrieving reference data, and the warning 'INFORMATIONAL ONLY — NOT TAX ADVICE. Verify with IRS...' provides an exclusion for using it as official advice. However, it does not explicitly state when to use this tool versus its siblings (e.g., 'use this for reference data, not for estimates'). The guidance is implied rather than explicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• check_tip_deduction_eligibilityA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden and excels: it lists exact return fields, states the informational-only nature, warns that occupation codes are placeholder slugs not validated against IRS codes, and declares the applicable tax-year window. This is thorough disclosure of behavior and limitations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is front-loaded with purpose and return values, then adds essential caveats. Every sentence earns its place: the disclaimers about tax advice and placeholder codes are critical for correct use, and the tax-year restriction is essential. No redundant or filler content.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema, the description lists the key return components (sunset status, transition relief, TTOC occupation eligibility, MAGI phase-out fraction, overall flag) sufficiently. It also provides scope (2025-2028), placeholder warnings, and verification guidance, making it complete for an informational eligibility-check tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the baseline is 3. The description adds value by warning that occupation codes are descriptive placeholders, not numeric Treasury codes, and by linking to `list_eligible_occupations` for valid codes. This goes beyond the schema's basic parameter descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('Checks whether...eligible'), the specific resource ('OBBBA No-Tax-on-Tips federal deduction'), and the scope ('without computing a dollar amount'). It distinguishes itself from siblings by explicitly excluding dollar-amount estimation and referencing `list_eligible_occupations` for code lookup.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use the tool: for eligibility checks only, not for dollar estimates. It also mentions using `list_eligible_occupations` for valid codes and advises verification with IRS/professional, but it does not explicitly contrast all sibling tools or specify exclusions (e.g., when to use `estimate_tip_deduction`).

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.