Server Quality Checklist

Tool Scores

• migrate-applyC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but only states the basic action without disclosing critical behaviors: it doesn't mention that this is a destructive/mutative operation (applies changes to database), potential risks (e.g., data loss), authentication needs, or output handling. This leaves significant gaps in behavioral understanding.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, direct sentence with zero wasted words, front-loading the core action. It efficiently communicates the essential purpose without unnecessary elaboration, making it highly concise and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (applies migrations, potentially destructive), lack of annotations, and no output schema, the description is incomplete. It fails to address behavioral risks, output expectations, or integration with sibling tools, leaving the agent under-informed for safe and effective use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema fully documents all 7 parameters. The description adds no parameter-specific information beyond implying 'pending migration files' relates to dirUrl. This meets the baseline for high schema coverage but doesn't enhance parameter meaning.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('apply') and target ('pending migration files to a database'), making the purpose understandable. However, it doesn't explicitly differentiate from siblings like migrate-status (which checks status) or migrate-diff (which compares), leaving room for improvement in sibling distinction.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like migrate-status or migrate-validate. It lacks context about prerequisites (e.g., after creating migrations with migrate-new) or exclusions, offering minimal usage direction.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• migrate-lintC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states the tool runs analysis to detect issues, which implies a read-only, non-destructive operation, but doesn't clarify aspects like whether it modifies data, requires specific permissions, has rate limits, or what the output entails (e.g., error messages, reports). This leaves significant gaps for a tool with 5 parameters and no output schema.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that directly states the tool's purpose without unnecessary words. It is front-loaded and appropriately sized, making it easy to parse while conveying the essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (5 parameters, no output schema, and no annotations), the description is insufficient. It lacks details on behavioral traits, output format implications (though 'format' parameter hints at this), and how it differs from siblings. For a migration analysis tool, more context on what 'issues' are detected or how results are used would improve completeness.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, so all parameters are documented in the input schema with clear descriptions. The description adds no additional meaning beyond the schema, such as explaining interactions between parameters (e.g., how 'latest' and 'gitBase' affect analysis) or providing examples. Baseline 3 is appropriate as the schema handles the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Run analysis') and target ('migration directory') with the purpose 'to detect issues', which is specific and actionable. However, it doesn't explicitly differentiate from sibling tools like 'migrate-validate' or 'migrate-diff' that might also involve analysis or validation of migrations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives like 'migrate-validate' or 'migrate-diff' from the sibling list. It mentions the general purpose but lacks explicit when/when-not instructions or prerequisites, leaving usage context implied rather than stated.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• migrate-statusC
  2.9/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden of behavioral disclosure. It states the tool reports status, implying a read-only operation, but does not cover critical aspects like authentication needs, rate limits, error handling, or what the report includes (e.g., migration progress, errors). This leaves significant gaps in understanding the tool's behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, clear sentence that directly states the tool's purpose without any wasted words. It is appropriately sized and front-loaded, making it easy for an agent to parse quickly and understand the core function.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of a migration status tool with no annotations and no output schema, the description is insufficient. It does not explain what the status report contains, how to interpret results, or any behavioral nuances, leaving the agent with incomplete context for effective use in a migration workflow.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema description coverage is 100%, so the schema already documents all parameters (url, dirUrl, format) with descriptions. The description adds no additional meaning beyond implying status reporting, which is covered by the tool's purpose. Thus, it meets the baseline for high schema coverage without compensating with extra insights.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Report') and resource ('current migration status of a database'), making the purpose understandable. However, it does not explicitly differentiate from sibling tools like 'migrate-apply' or 'migrate-validate', which likely perform different migration-related actions, so it lacks sibling distinction for a perfect score.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. It does not mention prerequisites, context, or exclusions, such as whether it should be used before or after other migration steps, leaving the agent with no usage direction beyond the basic purpose.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• migrate-newB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden for behavioral disclosure. While 'Create' implies a write operation, it doesn't specify what happens if the file already exists, whether this requires specific permissions, or what the resulting file structure looks like. The description is minimal and lacks important behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that gets straight to the point with zero wasted words. It's appropriately sized for a simple file creation tool and front-loads the essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with 3 parameters, no annotations, and no output schema, the description provides the basic purpose but lacks important context about behavioral traits, usage scenarios, and what happens after file creation. It's minimally adequate but leaves significant gaps in understanding how to effectively use this tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 100% schema description coverage, all three parameters are documented in the schema itself. The description doesn't add any additional meaning beyond what the schema provides about dirUrl, name, or edit parameters. The baseline score of 3 reflects adequate but not enhanced parameter documentation.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action ('Create a new empty migration file') and target resource ('in the migration directory'), making the purpose immediately understandable. However, it doesn't explicitly differentiate this tool from its siblings like migrate-apply or migrate-diff, which likely perform different migration-related operations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives. With multiple sibling tools (migrate-apply, migrate-diff, migrate-lint, etc.), there's no indication of when creating a new migration file is appropriate versus applying existing migrations or validating them.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• migrate-diffB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden but only states the basic action. It doesn't disclose behavioral traits like whether this is a read-only or mutating operation, what permissions are needed, how errors are handled, or what the output looks like (e.g., file creation details). For a tool with 6 parameters and no annotations, this is a significant gap.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that front-loads the core purpose without unnecessary words. Every element ('generate', 'new migration file', 'comparing current state to desired schema') earns its place by contributing essential information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (6 parameters, no output schema, no annotations), the description is incomplete. It doesn't explain the output (e.g., where the file is saved, format details), error conditions, or integration with sibling tools. For a migration generation tool, this leaves critical gaps in understanding its full behavior.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema fully documents all 6 parameters. The description adds no additional parameter semantics beyond implying a comparison between 'current state' and 'desired schema', which loosely relates to the 'to' parameter. Baseline 3 is appropriate when the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose as 'Generate a new migration file by comparing current state to desired schema', which specifies the verb (generate), resource (migration file), and method (comparing states). It distinguishes from siblings like migrate-apply (applies migrations) or migrate-status (checks status), but doesn't explicitly name alternatives for the comparison function.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for creating migration files through schema comparison, but doesn't explicitly state when to use this versus alternatives like migrate-new (creates empty migration) or migrate-validate (validates migrations). No guidance on prerequisites, exclusions, or specific scenarios is provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• migrate-validateB
  3.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It mentions 'validate' but doesn't disclose behavioral traits such as whether it's read-only, if it modifies data, error handling, or output details. The description is minimal and fails to provide necessary context for safe and effective use.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, efficient sentence that is front-loaded with the core purpose. There is no wasted language, and every word contributes directly to understanding the tool's function, making it appropriately sized and well-structured.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of migration validation (which could involve checks for consistency, integrity, and potential errors), the description is incomplete. With no annotations and no output schema, it lacks details on what the validation entails, what outputs to expect, or how to interpret results, leaving significant gaps for an AI agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents all parameters (dirUrl, devUrl, format) with clear descriptions. The description adds no additional meaning beyond the schema, such as explaining validation logic or parameter interactions, but meets the baseline since the schema does the heavy lifting.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with a specific verb ('validate') and resource ('migration directory'), specifying what it validates ('integrity and consistency'). It distinguishes from siblings like 'migrate-apply' or 'migrate-diff' by focusing on validation rather than application or comparison, though it doesn't explicitly name alternatives.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for validating migration directories, suggesting it should be used before applying migrations or after creating them. However, it lacks explicit guidance on when to use this tool versus alternatives like 'migrate-lint' or 'migrate-status', and no exclusions or prerequisites are mentioned.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.