Server Quality Checklist

Tool Scores

• list_diagramsA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It states what the tool does (detection without rendering) and describes the return format, but doesn't mention error conditions, performance characteristics, or whether both parameters can be used simultaneously. It provides basic behavioral context but lacks depth for a tool with two parameters.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is perfectly structured and concise: a clear purpose statement followed by separate Args and Returns sections. Every sentence earns its place, with no redundant information. The three-part structure (purpose, parameters, returns) is efficient and well-organized.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has an output schema (implied by 'Returns' section), the description doesn't need to fully document return values. However, with no annotations and 0% schema description coverage for inputs, the description should do more to explain parameter usage and constraints. It provides adequate context for a detection tool but could better address the two alternative input parameters.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the schema provides no parameter documentation. The description mentions both parameters in the Args section but only provides their names without explaining their purpose, relationship, or constraints. While it acknowledges the parameters exist, it doesn't add meaningful semantic information beyond what's already visible in the schema structure.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the specific action ('List all detected diagram blocks') and resource ('diagram blocks'), distinguishing it from sibling tools like 'render_all_diagrams' and 'render_diagram' by specifying 'without rendering them'. This provides immediate differentiation and clarity about what the tool does versus its alternatives.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by stating 'List all detected diagram blocks without rendering them', which suggests this tool is for detection/analysis rather than visualization. However, it doesn't explicitly state when to use this versus the rendering siblings or provide exclusion criteria. The context is clear but lacks explicit alternatives guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• render_diagramA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It effectively describes key behaviors: it renders only the first diagram found (not all), supports multiple input sources (file or raw text), and returns a specific dictionary structure. However, it doesn't mention error handling, performance characteristics, or authentication requirements.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is perfectly structured and front-loaded with the core purpose first, followed by organized parameter details and return information. Every sentence earns its place with no wasted words, making it easy for an AI agent to parse and understand.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's moderate complexity (6 parameters, no annotations, no output schema), the description provides excellent coverage of inputs and basic behavior. However, without an output schema, it could benefit from more detail about the return dictionary structure beyond just listing the keys. The description adequately covers the core functionality but leaves some implementation details unspecified.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage, the description fully compensates by providing clear semantic information for all 6 parameters. It explains what each parameter does, their default values, and valid options (e.g., output_format can be 'svg', 'png', 'jpeg', or 'pdf'), going well beyond what the bare schema provides.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose with specific verbs ('Render the first diagram found') and resources ('Markdown file or raw text'), distinguishing it from sibling tools like 'list_diagrams' (which lists diagrams) and 'render_all_diagrams' (which renders all diagrams rather than just the first).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context about when to use this tool (to render the first diagram from a Markdown source), but it doesn't explicitly state when NOT to use it or mention alternatives like using 'render_all_diagrams' for multiple diagrams. The sibling tool names provide some implicit guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• render_all_diagramsA
  4.6/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden and does well by disclosing key behavioral traits: it parses the entire document, finds every diagram block, renders each separately, optionally saves output files with specific naming conventions, and returns a list of result dicts. It doesn't mention performance implications, error handling, or file system permissions, but provides substantial operational context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is perfectly structured and appropriately sized: a clear purpose statement, followed by detailed behavioral context, then organized parameter documentation, and finally return value information. Every sentence earns its place with zero waste, and the information is front-loaded with the core functionality stated first.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (7 parameters, batch processing), no annotations, and the presence of an output schema, the description is remarkably complete. It covers purpose, behavior, detailed parameter semantics, and return structure. The output schema handles return values, so the description appropriately focuses on operational context and parameter guidance.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage for 7 parameters, the description compensates excellently by providing detailed parameter semantics in the Args section. It explains each parameter's purpose, acceptable values (e.g., output_format options, theme options), defaults, and even file naming conventions for output_dir. This adds substantial meaning beyond the bare schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Render ALL diagram blocks found in a Markdown file' with specific details about parsing the entire document, finding every diagram block, and rendering each separately. It distinguishes from sibling tools 'list_diagrams' and 'render_diagram' by emphasizing processing ALL diagrams rather than listing or rendering individual ones.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context about when to use this tool: for processing all diagrams in a Markdown file. It doesn't explicitly state when NOT to use it or name alternatives, but the context implies this is for batch processing versus the sibling 'render_diagram' for single diagrams. The guidance is clear but lacks explicit exclusions or named alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.