Server Quality Checklist

Tool Scores

• create_campaignD
  1.8/5.0
  Behavior1/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure but offers none. It doesn't indicate that this is a write operation (creating a resource), mention authentication requirements (though 'auth_token' is in the schema), discuss potential side effects (e.g., budget charges), rate limits, or what happens on success/failure. For a mutation tool with zero annotation coverage, this is critically inadequate.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise at three words, with zero wasted language. It's front-loaded with the core action ('Create'), though this brevity comes at the cost of completeness. Every word earns its place by directly stating the tool's function, albeit minimally.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness1/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (3 parameters with nested objects, no output schema, and no annotations), the description is severely incomplete. It doesn't address the mutation nature, authentication needs, parameter meanings, or expected outcomes. For a tool that creates resources with financial implications (budget), this lack of context is a major risk for correct agent usage.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 67%, meaning some parameters are undocumented in the schema. The description adds no parameter semantics beyond what's in the schema—it doesn't explain the purpose of 'ad_account_id', 'auth_token', or 'campaign_data', nor does it clarify relationships between parameters (e.g., that 'campaign_data' contains nested fields). With low coverage and no compensation in the description, significant gaps remain.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose2/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Create a new campaign' is a tautology that merely restates the tool name 'create_campaign'. It lacks specificity about what a 'campaign' is in this context (e.g., advertising campaign) and doesn't distinguish this tool from its siblings like 'update_campaign' or 'delete_campaign' beyond the basic verb. No additional context about the resource type or domain is provided.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines1/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an ad account), when not to use it (e.g., for modifying existing campaigns), or refer to sibling tools like 'update_campaign' or 'delete_campaign'. This leaves the agent with no contextual cues for tool selection.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• delete_campaignC
  2.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. 'Delete' implies a destructive, irreversible mutation, but the description doesn't disclose behavioral traits like permission requirements, side effects (e.g., what happens to associated ads), or confirmation steps. This is a significant gap for a destructive tool with zero annotation coverage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with zero waste. It's appropriately sized and front-loaded, though its brevity contributes to gaps in other dimensions. Every word earns its place in stating the core action.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (destructive mutation with 3 parameters), lack of annotations, and no output schema, the description is incomplete. It doesn't address critical aspects like what deletion entails, error handling, or return values, leaving the agent with insufficient context for safe and effective use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all parameters (ad_account_id, auth_token, campaign_id) with descriptions. The description adds no meaning beyond what the schema provides, such as explaining relationships between parameters or usage context. Baseline 3 is appropriate when the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose3/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Delete a campaign' clearly states the action (delete) and resource (campaign), but it's vague about scope and doesn't differentiate from siblings like 'update_campaign' which might also modify campaigns. It's a basic statement of purpose without specificity.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing an existing campaign), exclusions, or comparisons to siblings like 'update_campaign' for modifications instead of deletion. The agent must infer usage from the name alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• update_campaignC
  2.7/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the tool updates campaigns, implying mutation, but fails to describe critical behaviors such as permission requirements, whether updates are reversible, error handling, or side effects. This leaves significant gaps for a mutation tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise with a single sentence that directly states the tool's purpose. There is no wasted language or unnecessary elaboration, making it front-loaded and efficient, though this conciseness comes at the cost of detail.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a mutation tool with no annotations and no output schema, the description is insufficient. It lacks information on behavioral traits, usage context, and output expectations, leaving the agent with incomplete guidance despite the decent schema coverage for inputs.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 75%, with parameters like 'campaign_data' having nested properties documented. The description adds no additional parameter semantics beyond what the schema provides, but since the schema coverage is relatively high, a baseline score of 3 is appropriate as the schema does most of the work.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose3/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description 'Update an existing campaign' clearly states the action (update) and resource (campaign), but it's vague about what aspects can be updated and doesn't distinguish this tool from its sibling 'create_campaign' beyond the basic verb difference. It provides minimal but adequate purpose information.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives like 'create_campaign' or 'delete_campaign'. The description implies usage for modifying campaigns but offers no context about prerequisites, constraints, or typical scenarios for choosing this over other operations.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_campaignC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure but only states it retrieves details without specifying what 'details' includes, whether it's read-only, if it requires specific permissions, or how errors are handled. This leaves significant gaps for a tool that likely interacts with ad campaigns.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, clear sentence with no wasted words, making it easy to parse and front-loaded with the core purpose. It efficiently communicates the essential action without unnecessary elaboration.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the lack of annotations and output schema, the description is incomplete. It doesn't explain what details are returned, potential error conditions, or behavioral traits like idempotency or rate limits, which are crucial for an AI agent to use this tool effectively in a real-world context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, so parameters are well-documented in the schema itself. The description adds no additional meaning beyond implying 'campaign_id' identifies the campaign, which is already clear from the schema. This meets the baseline for high schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Get details') and resource ('for a specific campaign'), making the purpose understandable. However, it doesn't differentiate from sibling tools like 'get_campaigns' (plural) which likely retrieves multiple campaigns versus this single-campaign tool.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention that 'get_campaigns' might be for listing campaigns or that this tool requires specific IDs, nor does it address prerequisites like authentication or account context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_campaignsC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states a read operation ('Get') but lacks details on permissions, rate limits, pagination behavior, or response format. This leaves significant gaps for a tool that likely interacts with an API.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence with no wasted words. It is front-loaded and directly states the tool's purpose without unnecessary elaboration.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of a tool with 3 parameters, nested objects, no output schema, and no annotations, the description is insufficient. It does not cover behavioral aspects, response details, or usage context, making it incomplete for effective agent use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 67%, with parameters like 'ad_account_id' and 'filters' documented in the schema. The description adds no additional meaning beyond the schema, such as explaining filter usage or authentication context, but the schema provides adequate baseline coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('Get') and resource ('campaigns for an ad account'), making the purpose understandable. However, it does not distinguish this tool from its sibling 'get_campaign', which likely retrieves a single campaign, leaving some ambiguity about scope.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit guidance is provided on when to use this tool versus alternatives like 'get_campaign' or other siblings. The description implies usage for retrieving multiple campaigns but offers no context on prerequisites, exclusions, or specific scenarios.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.