Server Quality Checklist

Tool Scores

• get_migration_reportA
  4/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description clearly discloses that the tool is read-only and does not write files, which aligns with and adds context beyond the readOnlyHint annotation. It also explains that the report is returned as a string and that saving it is the caller's decision, which is useful behavioral guidance for an agent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is reasonably concise and front-loaded with the core action. It packs useful details into three sentences, but it has some redundancy: 'it does NOT write a file', 'you decide whether to save it', and 'this tool never modifies your files' all express similar read-only/no-file-write behavior.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description is complete for a read-only reporting tool of this complexity. It names the input scope, the output format, the report contents, and the file-writing behavior. Since an output schema exists and annotations cover read-only behavior, nothing critical is missing for an agent to decide whether to call this tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already documents the `path` parameter as an absolute path to a .ts file or directory. The description adds context by mentioning .html files and directories, but it does not materially expand the parameter semantics beyond what the schema describes. With 100% schema coverage, a baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies what the tool does: it scans .ts and .html files or a directory and returns a Markdown report with specific content (findings, complexity, file order, recipe names, version warnings). It distinguishes the tool from generic utility tools by naming the report contents, though it stops short of explicitly contrasting itself with the sibling analysis tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use this tool: when you need a combined migration report as a string rather than a file. It does not explicitly state when not to use it or which sibling tool should be used instead, such as `analyze_migration_complexity` for complexity-only analysis or `verify_migration` for validation afterward.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• analyze_migration_complexityA
  4.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The annotations already declare readOnlyHint=true and destructiveHint=false, so the behavior is largely covered structurally. The description reinforces the read-only guarantee and adds context about scanning behavior and result structure, but it does not disclose edge cases such as invalid paths or recursion behavior beyond what is already implied.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is compact and front-loaded: the first sentence states the input and output details directly, and the second provides a clear read-only safety note. There is no fluff, redundancy, or unnecessary beat-around-the-bush phrasing.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool has one required parameter, a simple input schema, output schema coverage, and clear annotations. The description supplies all the essential operational context: file types scanned, summarization outputs, file ordering rationale, and the mutation safety guarantee. Nothing critical is missing.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already documents the single path parameter with 100% coverage. The description further clarifies that the tool scans .ts and .html files, and notes the directory alternative, adding practical meaning beyond the schema. There is slight ambiguity about whether a standalone .html file path is accepted, but overall the description usefully extends the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb and resource: it scans .ts and .html files or a directory and summarises the migration. It also enumerates concrete outputs such as total findings, per-construct counts, and the mechanical/judgment split, which clearly distinguishes it from siblings like verify_migration or get_migration_report.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explains what the tool does and what it returns, but it does not explicitly state when to prefer this tool over siblings such as find_form_candidates or get_angular_upgrade_plan. It does not provide exclusions or an explicit when-to-use/when-not-to-use scenario, leaving usage mostly implicit.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_angular_upgrade_planA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint=true and destructiveHint=false, and the description reinforces this with 'Read-only: this tool never modifies your files.' It adds meaningful context beyond the annotations: the plan is reproduced from Angular's published step data (not written by this server), the output is markdown, and the current version is auto-detected from the project with optional overrides. It just does not cover edge cases such as what happens when the project is already above the required version.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Four sentences, front-loaded with the purpose and the trigger condition ('When a project is older, this returns the upgrade plan'). Each sentence pulls its weight: requirement, result/format/source, input choices matching the official guide, and the read-only guarantee. It is a touch dense but there is no dead weight and no repetition of the raw schema.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a read-only tool with full parameter descriptions, an output schema, and explicit read-only annotations, this description covers nearly everything: why it exists (Signal Forms needs 21+), when to call it (older projects), what comes back (official markdown plan), and which input choices to make (the official questionnaire parameters). Minor gaps remain, such as expected behavior when the project is already current or how the detected version is resolved from package.json, but these are edge cases, not blocking gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so each parameter already has a description, defaults, and constraints in the input schema. The description adds only slight glue (the choices are exactly what the official guide asks, the version is detected from the project), which is helpful but not a substantial extension of the schema. Baseline 3 is appropriate here; a higher score would require the description to clarify meanings the schema left unexplained.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a concrete deliverable — 'the upgrade plan as markdown' reproducing angular.dev/update-guide from Angular's published step data — and anchors it to a requirement (Signal Forms needs Angular 21+). It clearly distinguishes this tool from siblings like analyze_migration_complexity and get_migration_report, which are about analysis and reporting rather than the official step-by-step upgrade plan. The verb (returns) and the resource (the Angular plan from the official guide) are precise.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives a clear trigger condition: use it when a project is older than Angular 21+ so the tool emits the official upgrade plan. It also helps the agent select the right parameters by telling it to choose complexity and options 'exactly as the official guide asks.' It does not explicitly name the siblings as alternatives or say when not to use it, which keeps it below 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_signalforms_recipeA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Annotations already declare readOnlyHint=true and destructiveHint=false, and the description reinforces this with 'Read-only: this tool never modifies your files.' Beyond that, it adds a valuable behavioral edge case: unknown constructs return found:false plus available constructs and are never an error, which is more informative than standard error expectations. This exceeds the baseline set by the annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences with zero waste. The core behavior is front-loaded, followed by the edge case and a read-only guarantee. Every sentence earns its place, and no irrelevant information is included.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  This is a simple one-parameter lookup tool with a known input shape and an output schema. The description covers behavior, unknown-input handling, and side-effect safety, so an agent has everything needed to invoke it correctly. The output schema handles the return-value details, and the description covers the rest.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the parameter is already well documented. The description's examples ('FormControl', 'FormBuilder.group', 'Validators.required') mirror the schema's own examples and do not add new semantic depth. The description adds only a mild connection between the parameter and the resulting recipe concept, which keeps this at the baseline of 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with a precise verb+resource: 'Returns a verified before/after migration recipe for a single Reactive Forms construct.' It also gives concrete examples ('FormControl', 'FormBuilder.group', 'Validators.required') and distinguishes itself from sibling tools by targeting a single construct lookup rather than scanning, analysis, or reporting. This makes it unambiguous which tool an agent should select.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly implies the use case: looking up a recipe for a specific Reactive Forms construct. It doesn't explicitly name alternative tools, but the examples and single-construct scope make it evident as a lookup tool. However, it does not explicitly state when to prefer a sibling like find_form_candidates or verify_migration instead, leaving a small gap.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• find_form_candidatesA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Despite readOnlyHint being true, the description goes well beyond that by explicitly stating the tool never modifies files, results are paged, the default page size, and what `incomplete` means. It also communicates the mechanical/judgment classification logic, which is valuable beyond the annotations. No contradiction with annotations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three dense sentences each carry distinct value: scanning scope, read-only guarantee, paging, and filter guidance. The most important details are front-loaded and there is no filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is a read-only scanning utility, and the description covers all relevant operational aspects: input scope, safety, classification semantics, paging, and filtering. The presence of an output schema further covers return details, so no necessary information is missing.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already documents all parameters at 100% coverage, so the baseline is high. The description adds value by framing constructs/classification as a 'work one decision at a time' workflow and by highlighting paging constraints in the overall behavior.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the operation (scans .ts and .html files or a directory), the object (Angular Reactive Forms constructs), and the output distinction (mechanical vs. judgment). This differentiates it from sibling tools like analyze_migration_complexity or get_migration_report, which focus on broader analysis or reporting.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It explicitly describes path-based scanning, result filtering, and pagination workflow, saying to check `incomplete` for more results. It does not explicitly say when NOT to use this tool in favor of a sibling, but the operational guidance for how to use this tool is clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify_migrationA
  4.7/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Beyond the annotations, which already mark read-only and non-destructive behavior, the description adds important behavioral nuances: it only reports defects the compiler misses, it does not re-report compiler errors, and its results 'prove the ABSENCE OF KNOWN DEFECTS, never correctness.' This is exactly the kind of limitation disclosure that helps the agent set expectations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is dense but stays efficient: it front-loads the tool's core behavior, lists useful defect categories, states the run order relative to tsc, and closes with an epistemically honest caveat. Every sentence contributes meaningful decision-making information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a single-parameter read-only verifier with a 100%-documented schema and an output schema present, the description covers what the tool reads, what defects it finds, where it fits in the workflow, what it explicitly does not do, and its limits. Nothing needed to call it correctly is missing.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema covers the only parameter with 100% accuracy, including that the path must point to an already-migrated file or directory. The description reinforces this with 'reads code you have ALREADY migrated,' but it does not need to add parameter-level detail beyond what the schema already supplies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description identifies a specific verb+resource: it reads already-migrated code and reports Signal Forms traps that compile but are still wrong. It gives concrete examples and establishes that its scope is intentionally narrower than 'correctness checking,' making it distinguishable from migration-planning and reporting siblings.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives an explicit usage boundary: 'Run it after tsc, not instead of it.' It also states that compiler-reported errors are deliberately excluded, so an agent knows when the tool is and is not the right choice in a migration workflow.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.