Server Quality Checklist

Tool Scores

• get_market_oddsB
  3.4/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must cover behavioral traits. It mentions the output includes YES/NO prices, implied probability, volume, and metadata, but lacks disclosure on error handling, authentication requirements, rate limits, or what happens with invalid inputs.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise with two main sentences plus structured Args/Returns. Every sentence serves a purpose, and the main action is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With an output schema present, the description does not need to detail return structure, but it does mention key fields. It provides adequate context for a simple tool with two parameters, though missing guidance on error conditions or platform validation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has 0% description coverage, but the description adds valuable context: market_id format examples (Kalshi ticker, Polymarket condition_id) and platform values ('polymarket' or 'kalshi'). This compensates well for the schema gap.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool gets odds and pricing for a specific market, with verb and resource. It references sibling tools for obtaining market_id, distinguishing its purpose. However, 'detailed' is vague and could be more specific.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It advises using market_id from sibling tools, implying when to use this tool, but does not explicitly state when not to use it or compare with alternatives like find_arbitrage or get_category_markets.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• search_prediction_marketsA
  3.8/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden of behavioral disclosure. It explains the read-only nature (search) and states what is returned: 'current odds (YES/NO prices), volume, and direct links.' However, it does not mention potential side effects, error conditions, or limitations (e.g., rate limits, pagination), leaving some behavioral aspects unclear.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured with a clear first sentence stating purpose, followed by a bulleted args section. It includes useful examples but is slightly verbose with extra lines. The front-loading of the main action is effective.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the 0% schema description coverage and no annotations, the description covers all parameters, return format, and provides context via examples. It lacks details on edge cases (e.g., empty results) or platform-specific behaviors, but overall is sufficient for basic usage.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 0% parameter description coverage, but the tool description fully compensates by explaining all three parameters: query (with examples), platform (with default and options), and limit (with default and max). This adds significant meaning beyond the bare schema structure.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: 'Search prediction markets across Polymarket and Kalshi by keyword.' It uses a specific verb (search) and resource (prediction markets), and distinguishes itself from sibling tools like get_trending_markets by focusing on keyword-based retrieval.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides examples of search queries but does not explicitly state when to use this tool versus alternatives like get_category_markets or get_trending_markets. There is no guidance on when not to use it or which scenarios are better suited for sibling tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• find_arbitrageA
  4.1/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries full burden. It explains the arbitrage principle and return type, but omits details like auth needs, rate limits, or whether it performs a live scan. It is adequate but not rich.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise (~8 sentences) and front-loaded with purpose, followed by explanatory context. Each sentence adds value; no redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the single optional parameter and presence of an output schema, the description covers the tool's purpose, usage hints, and parameter meaning adequately. It could mention output structure but is sufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 0% description coverage, so the description's mention of 'min_spread_cents: Minimum spread to report in cents (default 2.0)' adds essential meaning beyond the schema alone.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's specific action: finding cross-platform arbitrage between Polymarket and Kalshi. It distinctly separates itself from sibling tools like get_category_markets or get_trending_markets by focusing on price discrepancy detection.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides context on typical arb spreads (1-5 cents) and warns that larger spreads (>20 cents) likely indicate non-equivalent markets, helping the agent interpret results. It lacks explicit when-to-use or when-not-to-use directives compared to alternatives.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_category_marketsA
  4.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must disclose behavioral traits. It states results are sorted by volume and returns JSON with markets, but does not mention if the operation is read-only, any side effects, or performance considerations. The description is adequate but could be more transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is well-structured with Args and Returns sections, concise yet informative. It could be slightly more compact, but it earns its sentences. No unnecessary words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (3 params, no required params) and the presence of an output schema, the description covers input parameters and return format adequately. It explains category values and sorting. It is complete enough for agent invocation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has 0% description coverage, so the description fully compensates by explaining each parameter: category lists valid values, platform explains options and default, limit explains default and max. This adds significant meaning beyond the schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: 'Browse prediction markets by category.' It lists specific categories, making it distinct from siblings like search_prediction_markets or get_trending_markets.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides categories and parameter defaults, implying when to use this tool for category-based browsing. It doesn't explicitly state when not to use it or name alternatives, but the context signals (sibling tools) and the listing of categories provide implicit guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_trending_marketsA
  4.3/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, description implies read-only behavior but does not explicitly state it is non-destructive or safe.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Concise with front-loaded purpose, clear parameter listing, and no wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Covers all essential aspects given low complexity and presence of output schema, but could mention error handling or platform validation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Since schema has 0% coverage, description fully explains both parameters: platform (with examples and default reasoning) and limit (with default and max).

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  Description clearly states the tool gets trending markets by trading volume, differentiating from siblings like search_prediction_markets or get_category_markets.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Provides clear context for when to use (to see current trending markets) but lacks explicit when-not-to-use or alternative tool guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.