Server Quality Checklist

Tool Scores

• add_moduleB
  3.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description reveals automatic dependency resolution, route/menu injection, and handler regeneration, which adds behavioral context. However, it omits side effects (e.g., file modifications, reversibility, permission requirements) and does not fully disclose the tool's impact.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences with front-loaded main purpose and additional features. Efficient, though a slight restructuring could separate features more clearly.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity (multiple automatic actions) and lack of output schema/annotations, the description is incomplete. It does not explain return values, prerequisites (project must exist), error conditions, or permanent changes, leaving significant gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, providing clear parameter meanings. The description does not add additional parameter-specific guidance (e.g., format constraints, order), so it meets the baseline but does not exceed it.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'add' and resource 'module' to an existing HWMS project, listing specific features (dependency resolution, route/menu injection, handler regeneration) that distinguish it from siblings like list_modules, resolve_dependencies, and generate_scaffold.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit guidance on when to use this tool versus alternatives. The description implies it's for adding modules to existing projects, but does not exclude cases like new projects, or advise using resolve_dependencies separately.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• generate_scaffoldB
  3.3/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must fully disclose behavioral traits. It mentions creation of files/directories, but omits critical details: whether it overwrites existing files, whether it requires a clean directory, side effects, or dependency installation. For a scaffold tool, these are important behavioral aspects missing from the description.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences in Korean, front-loaded with the core action. No filler words; every phrase adds value. The description is immediately understandable and efficient.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's moderate complexity (2 params, no output schema, no annotations), the description is minimal. It covers the basic purpose and outputs but lacks context on return values, error conditions, and workflow integration with sibling tools. It is adequate but not fully comprehensive.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, with both parameters well-documented. The description adds slight context ('with selected modules' and 'automatically creates project directory, module files, package.json, README.md'), but this largely reinforces rather than extends schema information. Baseline 3 is appropriate as schema handles the semantic load.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool generates a project structure with selected modules, listing specific outputs (directory, module files, package.json, README). This is a specific verb+resource combination that inherently differentiates it from sibling tools like list_modules (listing) and resolve_dependencies (resolving dependencies).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No guidance on when to use this tool versus alternatives. It does not mention prerequisites (e.g., having selected modules via list_modules), when not to use it, or typical workflow context. The description only states what it does, without any usage instructions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_modulesA
  3.6/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full responsibility. It discloses that the tool returns names, categories, and descriptions of 'verified' modules, adding some behavioral context. However, it does not mention authorization requirements, whether the list is static or dynamic, or any side effects. The disclosure is adequate but not comprehensive.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the core purpose, and contains no extraneous words. Every sentence contributes value, making it highly efficient and easy to parse.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (one optional parameter, no output schema), the description sufficiently explains the output (names, categories, descriptions). It could be slightly more complete by clarifying if the list is exhaustive or paginated, but for a basic list tool this is sufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has 100% coverage with the 'category' parameter already described as a filter with examples. The tool description adds no additional meaning beyond the schema, so baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool queries a list of available modules and specifies the returned fields (names, categories, descriptions of verified modules). It is specific with verb 'queries' and resource 'list of available modules', and distinguishes from siblings that handle dependency resolution, scaffold generation, and module addition.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives (resolve_dependencies, generate_scaffold, add_module). There is no explicit when/when-not context or mention of prerequisites, leaving the agent to infer usage purely from the tool name.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• resolve_dependenciesA
  3.7/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses that the tool adds dependency modules, checks conflicts, and returns env vars and config steps. However, it does not clarify whether modifications are permanent or reversible, error handling behavior, or any required permissions. The description is moderately transparent but leaves ambiguity about side effects.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences with no waste. The first sentence front-loads the core purpose, and the second adds specific details. Every sentence earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with one parameter, no output schema, and no annotations, the description covers the main purpose and outcomes. However, it is ambiguous whether the tool actually modifies the project or only returns information. It also lacks details on error handling, prerequisites, and the exact nature of the returned data. This gap reduces completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 100% coverage with a parameter description that matches the tool's description ('selected module name array'). The tool description adds context about dependency resolution but does not provide additional semantic meaning beyond what the schema already offers. Baseline 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool resolves dependencies of selected modules, including adding dependency modules, checking conflicts, and returning environment variables and configuration steps. This specific verb and resource distinguish it from siblings like list_modules (listing) and add_module (adding a single module).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for dependency resolution after selecting modules, but it does not explicitly state when to use this tool versus alternatives, nor does it mention prerequisites or when not to use it. The context of sibling tools provides some guidance, but the description itself lacks explicit usage guidelines.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.