Server Quality Checklist

Tool Scores

• get_graphA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations exist, so the description must convey behavior. It explains the output structure (nodes with workspace-relative path, label, type, unused flag, and import links), which is useful, but it provides no information about potential side effects, performance, or error cases. It is a read-only operation implied, but not explicitly stated.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that is information-dense without redundancy. It front-loads the key action and outcome.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with one parameter and no output schema, the description adequately describes the return value's composition. It could be improved by noting that the graph is computed from the project source or by clarifying the output format, but it's sufficiently complete for an agent to anticipate the result.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% (the only parameter 'root' has a clear description). The description adds no extra meaning beyond the schema's absolute path requirement, so baseline 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'Return' and clearly identifies the resource: the full Svelte component dependency graph, enumerating node fields and link types. This differentiates it from sibling tools like get_component (single component) and get_routes (routes only).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool's use case (needing the full dependency graph), but does not explicitly state when to prefer it over alternatives like get_unused or get_component. No exclusions or usage scenarios are provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_componentA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description takes on the full burden of behavioral disclosure. It explains not only that the tool retrieves a component but also details the exact information returned: parents, children, unused/route status, and Svelte 5 API surface (props and slots). This goes beyond a basic 'get' and gives the agent a clear model of the tool's output, though it does not mention error handling or performance characteristics.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences: the first states the core purpose with an example, and the second enumerates the return value components. There is no redundancy or filler, and the most important information is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given there is no output schema, the description does a good job of explaining what the tool returns, listing parents, children, unused/route status, props, and slots. It could be more detailed about the structure of those return values (e.g., whether parents are paths or names), but the main categories are covered, making it sufficiently complete for an agent to select and invoke the tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already describes both parameters (path and root) with clear descriptions and an example, yielding 100% schema coverage. The description adds no additional parameter meaning beyond restating what the schema provides, so the baseline of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'Look up a single component or route by its workspace-relative path'. It specifies the resource (component or route), the identifying method (path), and provides an example. This distinguishes it from sibling tools like get_graph, get_unused, and get_routes, which target different scopes or queries.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies its use case—when you need details about a single specific component—but it does not explicitly mention when to use it over alternatives or provide exclusions. Sibling tools exist, but the description does not reference them, leaving the agent to infer the appropriate context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_routesA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It explicitly reveals a read-only nature ('Return') and specifies the exact types of route nodes included and the output fields, which is useful context. However, it does not discuss edge cases or potential errors, but for a simple analysis tool, the description is adequately transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence that includes all essential details: the scope ('every route node'), the specific node types, and the output fields. No unnecessary words or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (one parameter, no output schema), the description adequately explains the return value. It is missing only comparative guidance on when to choose this over siblings, but for a basic route enumeration tool, the description is complete enough.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already documents the single 'root' parameter with 100% coverage, so the description adds no additional parameter semantics. With schema coverage that high, the baseline score of 3 is appropriate even without parameter details in the description.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states that the tool returns every route node, specifically enumerating the node types (+page/+layout/+error) and the information provided (display label and direct child components). This specific verb and resource combination distinguishes it from sibling tools like get_graph, which likely returns a broader graph structure.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies the tool is for enumerating route nodes with labels and children, but it does not explicitly state when to use this tool versus siblings like get_graph or get_component, nor does it mention alternatives or exclusions. The usage context is clear but not comparative.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• scanA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of disclosing behavior. It mentions cache invalidation and re-parsing every file, which implies a destructive/expensive operation. It also states the return value. It does not mention prerequisites, time cost, or potential side effects, but the core behavior is clearly disclosed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences: the first explains the action and return, the second gives the use case. Every word is purposeful, front-loaded, and there is no redundancy or filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (1 param, no output schema, no annotations), the description covers the essential aspects: what it does, when to use it, and what it returns. It lacks details about side effects or performance implications, but the provided information is sufficient for correct selection and invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema covers the sole parameter 'root' with a clear description ('Absolute path to the SvelteKit/Svelte project root to analyze'). Since schema coverage is 100%, the description need not add parameter details. The tool description does not add extra semantics beyond the schema, which aligns with the baseline score of 3.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's action: 'Invalidate all caches for the project and re-parse every file from scratch.' This is a specific verb+resource that distinguishes it from the sibling retrieval tools (get_graph, get_component, etc.). It also mentions the return summary, making the purpose unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit guidance: 'Use when you want to guarantee fresh results.' This indicates when to choose scan over the get_* tools. However, it does not explicitly name alternatives or explain when not to use it, stopping short of a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_unusedA
  4.3/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the behavioral disclosure burden. It adds the useful behavioral trait that the result is computed globally and independent of file order, which goes beyond the basic 'return' semantics and helps set expectations for the agent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences long, front-loads the core purpose, and includes a meaningful additional detail about global computation. Every word earns its place, with no redundant or vague phrasing.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple (one well-documented parameter) and the description fully specifies its purpose and key behavioral characteristic. Even without an output schema, the description is sufficient for an agent to invoke the tool and understand the expected result.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already provides a 100% description coverage for the single 'root' parameter (absolute path to the project root). The description does not add additional parameter-specific semantics, so the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Return' and a clear resource definition: 'every component that is imported somewhere in the project but rendered nowhere'. This precisely distinguishes the tool from siblings like get_component or get_routes, which target different aspects of the project.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly implies when to use the tool (to find unused components) and notes that it is computed globally, giving context. However, it does not explicitly mention alternatives or exclusions, so it falls short of a 5 on the usage guidelines scale.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.