Server Quality Checklist

Tool Scores

• reach_hotB
  3.1/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It only describes what data is returned, not any behavioral traits like read-only nature, rate limits, or authorization requirements. Basic functional description without side-effect disclosure.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence with parentheticals, efficient but slightly dense. No redundant information, but could be structured more clearly with bullet points for each source.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema, the description omits details about output format, pagination, sorting, or error handling. It adequately states purpose but lacks operational context for complete agent use.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With 0% schema description coverage, the description adds meaning by listing platforms (hackernews, news, discourse) and regional options (india, western) that map to 'platform' and 'region' parameters. However, 'limit' parameter is not mentioned, and parameter mapping is implicit.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool provides trending listings from specific sources: hackernews front page, news (with regional options), and discourse forum topics. It uses a specific verb 'reach' but purpose is clear and distinguishes from siblings by focusing on 'hot' content.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for retrieving trending content but does not explicitly state when to use this tool versus alternatives like reach_read or reach_search. No exclusions or prerequisites are provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• reach_searchA
  3.9/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It discloses that social media platforms require a logged-in browser session and OpenCLI, and specifies search behaviors (e.g., semantic vs. symbol lookup). This is valuable behavioral context beyond the schema.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness3/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single long sentence listing platforms and their specifics. While informative, it lacks clear structure (e.g., bullet points) and could be more concise. It earns a 3 as it is functional but not optimally organized.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity of supporting multiple platforms with different behaviors, the description covers key aspects: platform options, search types, and prerequisites. It does not explain return format or pagination, but for a search tool this is adequate.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0%, so description must compensate. It explains platform values well but provides no detail on query or limit parameters. The query and limit remain underspecified, leaving ambiguity for the agent.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool is for searching multiple platforms like web, youtube, github, etc., with specific search types (e.g., Exa semantic search, stock symbol lookup). It distinguishes itself from sibling tools like reach_read by focusing on search across diverse sources.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit guidance on which platform to use based on the data source needed, and notes prerequisites (e.g., OpenCLI for social media). However, it does not explicitly compare to alternatives like reach_hot or reach_research.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• reach_doctorA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description discloses that it returns status, backend, and a fix prescription, implying a read-only diagnostic operation. However, with no annotations, it does not address potential side effects, rate limits, or authentication needs. The behavioral traits are partially transparent but not fully detailed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, informative sentence that covers the purpose and output. It is concise and front-loaded, though it could be slightly more structured. Overall, it earns its place with no wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a zero-parameter tool with no output schema, the description completely explains what the tool does and what it returns (status, backend, fix prescription). There are no hidden behaviors or missing details; it is fully self-contained.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has no parameters, so schema coverage is 100% (vacuous). Per guidelines, baseline is 4. The description adds meaning by explaining what the tool does and returns, which is sufficient for a zero-parameter tool.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool performs a health-check on every channel, returning status, backend, and fix prescription. This is specific and distinct from sibling tools like reach_read, reach_search, etc., which imply different operations.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  No explicit when-to-use or when-not-to-use guidance is provided. The purpose is implied through the description, but alternatives are not discussed. Given the sibling list, it is the only health-check tool, so confusion is low, but the lack of explicit guidelines prevents a higher score.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• reach_researchA
  4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It discloses parallel execution, merged Markdown output with per-source notes, and region parameter behavior. It does not mention error handling or rate limits, but the behavioral traits for a read-only research tool are adequately conveyed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise: two sentences with an additional parenthetical for region. No redundant phrases, front-loaded with core purpose. Every sentence adds value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema, the description provides reasonable completeness: explains output format (merged Markdown with per-source notes) and key parameter behavior. It doesn't detail error behaviors but is sufficient for typical use. Sibling context helps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0%, so description must compensate. It explains the region parameter values clearly but does not describe the 'limit' parameter (integer default 8). The 'query' parameter is self-explanatory. Partial compensation, missing one param.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states it performs cross-platform research by fanning out queries in parallel across specified sources (web, Hacker News, news, YouTube, etc.). It distinguishes itself from sibling tools like reach_search (likely single-platform) by emphasizing the multi-source parallel approach.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  While the description implies use for broad research across multiple platforms, it lacks explicit guidance on when to use this tool versus alternatives like reach_search or reach_hot. No when-not scenarios or alternative recommendations are provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• reach_readA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description discloses automatic routing, degradation, and meta.setup_hint. Does not cover auth or error handling, but provides substantial behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Front-loaded with main purpose, followed by platform list and degradation. Efficiently structured with no wasted sentences, though it could be slightly more concise.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given complexity (multiple routing, stock tickers, degradation) and no output schema, the description covers key behaviors. Missing details on return format but sufficient for an agent.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema has 0% description coverage. Description adds meaning for the 'url' parameter (accepts stock tickers) but does not explain 'max_chars' beyond its default. Partially compensates for missing schema descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Explicitly states 'Read any URL as clean text/Markdown' and lists specific platform routings (YouTube, GitHub, etc.), distinguishing it from siblings like reach_search which is for searching.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Implicitly tells when to use (when you have a URL to read) and notes degradation behavior. Does not explicitly state when not to use or alternatives, but context is clear.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• reach_platformsA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It lists platforms and operations but does not disclose any behavioral traits like auth requirements, side effects, or output format. A 3 is adequate given the simplicity of a listing tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  A single sentence that is front-loaded and efficient with no wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no output schema and no annotations, the description is fairly complete. It covers the tool's main purpose but could mention return format or how operations are indicated.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  No parameters exist and schema coverage is 100% (empty schema). Baseline 4 applies as the description need not add param info.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool lists every platform and their supported operations (read/search/hot), using a specific verb and resource. It distinguishes from siblings which perform operations on platforms.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The usage context is implied but not explicit. It is clear this tool is for discovering platform capabilities before using sibling tools, but no when-not or alternative guidance is provided.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.