Server Quality Checklist

Tool Scores

• execute-toolB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description must carry the weight of behavioral disclosure. It only mentions the connection requirement; it does not disclose that executing actions may have side effects, mutate external systems, or what guarantees exist around execution. This is a significant gap for an 'execute' tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that is front-loaded with the core purpose ('Execute an integration action/tool') followed by a critical prerequisite. There is no redundancy or filler, perfectly earning its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has 3 parameters, a nested object, and an output schema, the description is minimal but adequate for a generic execution wrapper. It mentions the connection prerequisite but does not address error handling, long-running behavior, or side effects. The output schema covers return values, so that absence is less critical.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema provides descriptions for all parameters (100% coverage), including 'action', 'timeout', and 'parameters'. The tool description itself adds no additional parameter-level meaning, so it relies on the schema. Baseline of 3 applies because schema coverage is high.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function as 'Execute an integration action/tool', with 'execute' as a specific verb and 'integration action/tool' as the resource. This distinguishes it from siblings like 'search-tools' (searching) and 'list-connections' (listing), though it does not explicitly name those alternatives.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a key prerequisite ('Requires an active connection for the integration'), which implicitly guides when to use the tool. However, it does not explicitly state when to use this tool versus alternatives or add exclusion guidance, leaving usage largely inferred.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• disconnect-appA
  3.6/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description must carry the full burden of behavioral disclosure. It does disclose a significant behavioral trait: 'revoking all connections,' indicating a broad, likely destructive action. However, it does not mention permanence, reversibility, permissions, or other side effects, leaving gaps in the safety profile.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that front-loads the action and its effect. It is concise, with no wasted words, and includes the critical qualifier 'all connections' without unnecessary elaboration.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with only one parameter and an output schema, the description is nearly complete. It states the purpose and the key behavioral scope (all connections). However, it could benefit from noting that the action is likely irreversible or requires reconnection, which would enhance completeness given the lack of annotations.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema covers the single parameter 'integration' with a clear description ('Integration ID or slug to disconnect'), providing 100% schema coverage. The tool description does not add additional semantic meaning beyond what the schema already documents, so a baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'Disconnect from an integration, revoking all connections.' It uses a specific verb ('disconnect') and resource ('integration'), and explicitly notes the scope ('all connections'), which distinguishes it from sibling tools like list-connections and connect-app.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance is provided on when to use this tool versus alternatives. The description does not mention prerequisites, exclusions, or reference sibling tools like connect-app or list-connections. The intended context is only implied by the tool's name and description.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list-connectionsA
  3.7/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It reveals that only active connections are returned, which is useful, but it does not describe the output format, pagination, or any other behavioral traits.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise at two short sentences. Every word serves a purpose, and the key information is front-loaded in the first sentence.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple list tool with no parameters and an output schema, the description is mostly complete. However, ambiguity with the sibling 'list-integrations' tool and lack of any note about output details slightly reduce completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With zero parameters and 100% schema coverage, the baseline is 4. The description adds semantic value by qualifying the result as 'active' connections, which is not otherwise captured in the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool lists active integration connections, with the specific resource 'active integration connections' and a clarifying purpose. It partially distinguishes from sibling 'list-integrations' by emphasizing 'already connected', but doesn't explicitly contrast them.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The phrase 'Use this to see which integrations are already connected' provides a clear use case. However, it does not mention alternatives or exclusions, such as when to use 'list-integrations' instead, leaving some ambiguity.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• connect-appA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the transparency burden. It discloses the two authentication modes and that OAuth returns an authorization URL for the user to complete. However, it does not mention side effects like whether the connection is persisted or whether API keys are validated, leaving gaps for an agent to infer.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two concise sentences, front-loaded with the main purpose, and provides enough detail without unnecessary fluff. Every sentence adds value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's moderate complexity (3 params, output schema present, sibling context), the description covers the primary decision branches and return behavior adequately. It could be more explicit about post-connection behavior but is reasonably complete for an agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so parameters already have descriptions. The tool description adds some contextual grouping (API key for API-key integrations, scopes for OAuth) but does not provide additional syntax or specifics beyond the schema, meeting the baseline of 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with a specific verb and resource: "Connect to an integration/app." It also distinguishes the tool from siblings by describing the action of establishing a connection, unlike list-connections, disconnect-app, or execute-tool.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear usage context by distinguishing API-key and OAuth flows, telling the agent what to expect for each. However, it does not explicitly mention when to use this tool instead of siblings or when not to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search-toolsA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden. It discloses the semantic search (RAG) mechanism, implying a read-only discovery operation, but lacks details on pagination, result limits, or edge cases. The output schema compensates for return structure, but behavioral nuance is limited.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise, front-loaded sentences with zero redundancy. It states the core function and a clear usage directive without unnecessary filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a search/discovery tool, the description covers purpose, usage, and leverages the output schema for return details. It could explicitly name sibling tools for contrast, but the existing guidance is sufficient for an agent to select and invoke the tool correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Parameter descriptions in the schema cover 100% of parameters, so the description adds no extra semantics. The mention of 'specific task or integration' loosely hints at query usage but does not go beyond the schema, warranting the baseline score.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool searches for available integration tools/actions via semantic search (RAG), using a specific verb and resource. It distinguishes itself from siblings like list-integrations by emphasizing discovery through search rather than simple enumeration.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides explicit guidance: 'Use this to discover what tools are available for a specific task or integration.' This tells the agent when to invoke this tool, though it does not explicitly mention alternatives or when not to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list-integrationsA
  4.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the burden. It adds a useful behavioral scoping ('that can be connected') to clarify what is returned, but doesn't explicitly state side effects or pagination behavior beyond what the schema already indicates. This is adequate for a simple list operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Single sentence, clearly worded, with no filler. It front-loads the verb and resource.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple two-parameter list tool with a full output schema, this one-sentence description is sufficient. It captures the key distinction from list-connections and doesn't leave significant gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already provides complete descriptions for both `limit` and `search`, so the description doesn't need to add parameter details. It adds no extra parameter semantics beyond the schema, which is acceptable per baseline.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'List' with the resource 'available integrations/apps that can be connected', clearly distinguishing from sibling tools like list-connections (which likely handles existing connections). It clearly states what the tool does.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by noting that these are integrations 'that can be connected', which differentiates this from list-connections. However, it doesn't explicitly name alternatives or provide when-not-to-use guidance, so it falls short of a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.