Server Quality Checklist

Tool Scores

• explore_reddit_discussionsA
  3.7/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of disclosing behavior, and it does so meaningfully: it reveals output fields (upvote_ratio, age_in_days, next_page_token), explains how to interpret them, and signals pagination. It could add limitations (e.g., rate limits, scope of data), but it gives a solid behavioral picture for a read-only exploration tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is three short, front-loaded sentences with no filler. Each sentence earns its place: purpose, output interpretation, and pagination. The use of `code` formatting for field names is clean and scannable.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with 6 parameters, no annotations, and 0% schema coverage, the description is incomplete: it omits input parameter semantics and tool-selection context. It does cover purpose, key output interpretation, and pagination, and an output schema likely exists, which reduces the need to document return values. Overall, adequate but with clear gaps.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate, but it only references next_page_token and output fields, not the actual input parameters. It does not explain keyword, sort, limit, subreddit, page_token, or time_filter. The agent is left to infer meaning from enum names and defaults, which is a significant gap.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies the tool's purpose: 'gauge public opinion and market acceptance' via Reddit discussions. It adds a step context ('STEP 2: SENTIMENT EXPLORATION') and specific behavioral cues (upvote_ratio, age_in_days), making the resource and intent clear. It does not explicitly differentiate from sibling tools like extract_public_opinion, so it falls short of a 5.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a clear use case: 'Use this to gauge public opinion and market acceptance,' and frames it as step 2 in a workflow. It offers practical guidance on interpreting results (upvote_ratio thresholds, age_in_days) and pagination. However, it gives no exclusions or alternatives despite likely overlap with sibling tools, so it lacks full when-not-to-use guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_knowledgeA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the behavioral burden. It transparently discloses that it uses DuckDuckGo and that pagination is not supported, which helps agents understand result scoping. It does not mention rate limits or auth, but for a read-only search tool the disclosed traits are helpful.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is tightly written in three short sentences with no filler. Each sentence adds value: purpose, mechanism, and a key limitation.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The output schema and input schema cover the technical fields, and the description supplies workflow positioning and the no-pagination constraint. This is enough for an agent to select and invoke the tool effectively, though a bit more explicit sibling differentiation would make it perfect.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has 0% description coverage and the description does not mention query, limit, subreddit, or time_filter by name. It only implicitly suggests that query is free-text, so the description fails to compensate for the low schema coverage.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's role as 'STEP 1: FOUNDATION SEARCH' and its purpose: to find 'factual threads or technical explanations.' It also distinguishes itself from siblings by noting it uses a broad DuckDuckGo web search to find Reddit threads that Reddit's own search might miss.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides a clear when-to-use context ('STEP 1: FOUNDATION SEARCH') and explains the broad web-search approach. It mentions the no-pagination limitation, but it does not explicitly list exclusions or name alternative tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• analyze_niche_trendsA
  4.2/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the full burden of behavioral transparency. It mentions that it looks at 'rising' or 'hot' posts, but it does not disclose that the tool likely makes a network request (potential latency, API limits), or that results are dynamic based on current Reddit data. It doesn't explain that it may return posts outside the niche if not filtered properly. The description adds some behavioral context (using 'Rising' to find current struggles) but falls short of fully disclosing expected behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise, with three sentences that are directly relevant. It front-loads the primary use case, then adds a practical tip for the agent. No redundant information or filler; every sentence earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's complexity (4 parameters, including a pagination token and trend type) and the absence of annotations, the description covers the essential semantics and usage guidance. However, it does not mention the output schema, which could be beneficial for agent understanding, but since an output schema exists, the description doesn't need to explain return values. The lack of detail on `limit` and `page_token` is a minor gap, but overall the description is sufficient for the agent to select and invoke the tool correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate for parameter meaning. It explicitly references `created_at` and `current_server_date`, and by mentioning 'rising' or 'hot' it indirectly explains `trend_type` as a way to filter posts. It also implies the use of `subreddit_name` to define the niche. While it doesn't detail `limit` or `page_token`, the description provides enough context for the key parameters, earning a 4.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: to analyze niche trends for suggesting ideas and finding pain points based on rising/hot posts. It explicitly names the resource (specific niche) and the action (analyze trends), and it distinguishes itself by focusing on identifying immediate user problems, unlike sibling tools which focus on knowledge search, general discussions, opinion extraction, or saved posts.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly states when to use the tool ('when asked to suggest ideas, find pain points, or discover opportunities in a specific niche') and implies when not to (e.g., for general discussions or knowledge searches). It also provides a key usage guideline: compare post dates with the current server date to ensure trends are recent, which is critical for the tool's intent.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• extract_public_opinionA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of transparency. It discloses important behaviors: filters bots/noise, requires citations using comment_url, supports pagination via next_page_token, and token ownership restrictions. While it doesn't mention auth or error handling, it covers the core behavioral traits needed for invocation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is compact (~70 words) but information-dense, using clear labels (DEEP DIVE TOOL, Citations, Pagination) to organize content. Every sentence serves a purpose: usage, filtering, citation, pagination, token behavior. No fluff or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a tool with no annotations, the description provides a thorough operational picture: purpose, usage context, output requirements, pagination, and token constraints. It leaves out max_comments semantics and explicit platform scope (though 'reddit:' token example hints at Reddit), but overall it's sufficient for selecting and invoking the tool correctly. Output schema exists, so return format needn't be described.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 0%, so the description must compensate. It explains post_url implicitly and page_token (as next_page_token) well, including provider-prefixed token syntax. However, max_comments is not mentioned at all, leaving that parameter without semantic guidance beyond the schema's numeric constraints. Partial compensation for 2 of 3 parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies the tool as a 'DEEP DIVE TOOL' that extracts 'PURE human opinions' from a post, filtering noise and bots. It distinguishes itself from sibling search/exploration tools by specifying it operates on a specific post found via search, making its purpose specific and non-overlapping.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly states 'Use this ONLY after finding a relevant post via search tools,' which clearly defines when the tool is appropriate. This provides strong guidance on prerequisites and differentiates it from search tools, even if not naming siblings directly.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_saved_postsA
  4.4/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full responsibility for behavioral disclosure. It transparently reveals that posts are fetched newest-first, lacks scores/comments, filters thin titles, and does not support pagination—critical details for an agent's expectation management. This exceeds minimal disclosure and clearly states limitations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single dense paragraph, but every sentence adds unique value: what it does, use cases, and key limitations. It is slightly run-on but avoids redundancy. A sentence or two could be combined for better scanning, but it remains efficient and direct.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a read-only tool with only two optional parameters and an output schema (which presumably defines the return structure), the description covers all critical aspects: data scope, ordering, filtering edge cases, and unsupported features. It gives an agent sufficient context to decide when to call this tool and what to expect from the response.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 0%, meaning the description must add parameter understanding. While it explains the 'defined time period' concept matching time_filter and implies limit behavior via 'no pagination', it never names the parameters or adds detail about them (e.g., default limit=50, max=100). The description is vague regarding how limit behaves beyond absence of pagination, earning a baseline score given schema already documents the parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool fetches the user's saved Reddit posts for a defined time period, with a clear verb+resource combination. It even specifies use cases ('revisit, summarize, or triage') and distinguishes itself from typical feed tools by emphasizing its personal nature, effectively separating it from the sibling tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides explicit when-to-use guidance ('Use this to revisit, summarize, or triage content the user explicitly bookmarked') and notes limitations (no scores/comment counts, filtered thin titles, no pagination). However, it does not explicitly name alternatives for when to use sibling tools, so it falls slightly short of a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.