Server Quality Checklist

Tool Scores

• ffs_get_flag_optionsC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It states this is a read operation ('Get'), but doesn't mention any behavioral traits such as permissions required, rate limits, error handling, or what the output format looks like (e.g., list of values). This is a significant gap for a tool with no annotation coverage.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's purpose. It's front-loaded and wastes no words, though it could be slightly more structured by separating usage hints into a second sentence. Overall, it's appropriately concise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has no annotations, no output schema, and a simple input schema, the description is incomplete. It doesn't explain what the return values look like (e.g., a list of options with IDs and labels), any dependencies, or error cases. For a tool that fetches data, more context on output behavior is needed to be fully helpful.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage, with the single parameter 'flagId' documented as 'Complete FFS Flag ID'. The description adds minimal value beyond this by implying the parameter is used to fetch options for a specific flag, but doesn't provide additional context like format examples or constraints. Baseline 3 is appropriate given the high schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'Get' and the resource 'all available options (values) for a Flag', making the purpose understandable. However, it doesn't explicitly differentiate this from sibling tools like 'ffs_search_flag' or 'ffs_update_account', which might also involve flags, so it misses full sibling distinction.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It mentions 'Value IDs needed for updates', which hints at a use case for preparing updates, but doesn't specify when to choose this over other tools like 'ffs_search_flag' or what prerequisites exist. This leaves usage context largely implied.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ffs_search_flagC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It states the tool searches and returns data, implying a read-only operation, but doesn't cover critical aspects like authentication needs, rate limits, error handling, or pagination. For a search tool with zero annotation coverage, this leaves significant gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core purpose ('Search for FFS flags by keyword') and adds necessary detail about returns. There is no wasted verbiage or redundancy, making it appropriately concise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the lack of annotations and output schema, the description is incomplete. It doesn't explain the return format in detail (e.g., structure of 'matching flags'), error conditions, or behavioral constraints. For a search tool with no structured output documentation, more context is needed to guide the agent effectively.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% description coverage, with the 'keyword' parameter fully documented in the schema. The description adds minimal value by restating that it searches 'by keyword' and mentions 'complete Flag ID,' but this is already implied in the schema. Baseline 3 is appropriate as the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Search for FFS flags by keyword.' It specifies the verb ('Search') and resource ('FFS flags'), and mentions the return format ('matching flags with their IDs and types'). However, it doesn't explicitly differentiate this search tool from its siblings (e.g., ffs_get_flag_options), which prevents a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It doesn't mention any prerequisites, exclusions, or comparisons with sibling tools like ffs_get_flag_options or ffs_check_account. The agent must infer usage from the tool name and description alone.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ffs_update_accountC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It indicates an update operation, implying mutation, but doesn't specify permissions required, whether changes are reversible, error handling, or rate limits. The mention of 'MCP Auto Condition for management' adds some context but is vague, failing to fully compensate for the lack of annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise with two sentences that efficiently convey the tool's purpose and mechanism. It avoids unnecessary details and is front-loaded with the core action. However, the second sentence about 'MCP Auto Condition' could be more specific to enhance clarity without adding length.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of an update operation with no annotations and no output schema, the description is insufficient. It lacks details on behavioral traits (e.g., side effects, permissions), response format, or error conditions. While the schema covers parameters well, the overall context for safe and effective use is incomplete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all three parameters (flagId, id, targetValueId) with clear descriptions. The description adds minimal value by implying the parameters are used for updating a flag value, but it doesn't provide additional syntax, format details, or usage examples beyond what the schema offers, meeting the baseline for high coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Update') and the target ('an AccountId or ExtensionId'), specifying what gets updated ('to use a specific Flag value'). It distinguishes from siblings like ffs_check_account (which likely checks rather than updates) and ffs_get_flag_options (which likely retrieves options). However, it doesn't explicitly differentiate from ffs_search_flag or ffs_get_user_info, keeping it from a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description mentions 'Uses MCP Auto Condition for management,' which provides some context about the mechanism, but it doesn't offer explicit guidance on when to use this tool versus alternatives like ffs_check_account or ffs_search_flag. No prerequisites, exclusions, or clear scenarios are stated, leaving usage ambiguous.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ffs_check_accountB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the tool checks status but doesn't explain what 'status' entails (e.g., enabled/disabled, active/inactive), whether it's a read-only operation, if it requires authentication, or any rate limits. This leaves significant gaps in understanding the tool's behavior beyond the basic action.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's purpose without unnecessary words. It is front-loaded with the core action and resource, making it easy to parse quickly, and every part of the sentence contributes essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has 2 parameters with full schema coverage and no output schema, the description adequately covers the basic purpose. However, it lacks details on what 'status' means in the return value, which is crucial since there's no output schema. For a status-checking tool with no annotations, more context on the expected output or behavioral traits would improve completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents both parameters ('flagId' and 'id') with clear descriptions. The description adds minimal value by mentioning 'AccountId or ExtensionId' for the 'id' parameter, but doesn't provide additional context like format examples or constraints beyond what the schema states, meeting the baseline for high coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Check'), the target ('status of an AccountId or ExtensionId'), and the context ('in a Flag'). It specifies what resource is being operated on, though it doesn't explicitly differentiate from sibling tools like 'ffs_get_user_info' or 'ffs_search_flag' which might also retrieve status information.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like 'ffs_get_user_info' or 'ffs_search_flag'. It lacks context about prerequisites, such as whether the flag must exist or if the ID needs to be valid, and doesn't mention any exclusions or specific scenarios for its use.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• ffs_get_user_infoA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It describes the core behavior (retrieving IDs from credentials) but lacks details on authentication requirements, error handling, rate limits, or response format. It adds some context about credential usage but misses broader behavioral traits.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is front-loaded and highly concise with two clear sentences: one stating the purpose and another providing usage guidance. Every word earns its place without redundancy or fluff.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's low complexity (2 parameters, no output schema, no annotations), the description is reasonably complete for its purpose. It explains what the tool does and how to use the outputs, though it could benefit from mentioning response format or error cases to be fully comprehensive.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents both parameters (username and password) fully. The description doesn't add any parameter-specific details beyond what the schema provides, such as format examples or constraints, meeting the baseline for high schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with specific verbs ('Get AccountId and ExtensionId') and resources ('from RingCentral credentials'), distinguishing it from siblings like ffs_check_account or ffs_update_account by focusing on credential-based ID retrieval rather than account checking or updating.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides explicit usage guidance by specifying when to use the returned IDs: 'Use ExtensionId for individual user, AccountId for entire company.' This helps differentiate from alternatives by clarifying the context for each output, though it doesn't name specific sibling tools for comparison.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.