Server Quality Checklist

Tool Scores

• btcmatic_topup_claimB
  3.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description discloses the exactly-once guarantee, the side effect of resuming/restarting the server, and the environment variable requirement. Without readOnly/destructive annotations, the description itself bears this weight, but it does not mention permissions, rollback, or other behavioral consequences.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  It consists of two dense but useful sentences and a collateral instruction. Every word contributes; no fluff. Well formatted.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  There is no output schema, no description of a return value, and not much context for the cryptographic token value or exceptions. Task states input requirements but not output. It also relies on an operational detail (surcharge) but not the actual meaning of a state restoration.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema has parameters (preimage, payment_hash) with regex patterns but no descriptions. The description only reluctantly refers to them as 'payment preimage' and 'payment hash', adding little value beyond the schema. There are no defaults or types. With <50% schema coverage, information is scarce.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('proves'), identifies the resource (a paid top-up as a bearer token), and details unique behavior: the prepayment is proven via its hahs preimage, and the token is received exactly once. The wording 'EXACTLY ONCE' and 'store it' distinguishes this claim operation from sibling tools, but it does not explicitly name itself a top-up claim operation or contrast with alternatives.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It establishes usage context by explaining that claiming the token precedes restarting the server with the agent token so that all paid tools automatically debit the balance. It does not, however, explicitly state when to use this instead of a sibling tool or include exclusion criteria.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• btcmatic_creditsB
  3.4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the transparency burden. It does disclose that the operation is free and what it returns, but it does not explicitly state that it is read-only or describe any side-effect-free behavior.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is only two short sentence fragments, front-loaded with the most important fact (free) followed by a clear purpose statement. Every word earns its place with no redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple tool with one optional parameter and no output schema, the description covers the essential purpose, cost, and return value (remaining calls). It is complete enough for an agent to invoke it correctly, though it could mention relationship to topup tools.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100% for the single optional 'token' parameter, which already has a description ('Override the configured token'). The tool description adds no additional parameter semantics beyond what the schema provides, so baseline 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states the tool returns the balance behind the configured prepaid token and how many calls it covers. This clearly differentiates it from the sibling topup tools, though it lacks an explicit verb like 'check' or 'get'.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description says 'Free' but gives no explicit guidance on when to use this tool versus the topup siblings. There is no mention of checking balance before topping up or any exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• btcmatic_condition_frequencyA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the behavioral burden. It reveals that it counts rising edges (throttled rule fires) and hours held, and clarifies it is not a forecast. However, it omits details like credit consumption (though title says paid), exact output format (e.g., integer counts), or any side effects. The 'rising edges' context adds value, but completeness is limited.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two sentences, front-loaded with the core action, and efficient. Every sentence adds unique information: the first explains the counting mechanism and metrics/operators; the second clarifies scope ('Past frequency'). No fluff or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity (6 params, no output schema), the description adequately explains the tool's purpose, granularity, and output (counts and hours held). It also flags the 'not a forecast' caveat. It does not spell out the exact response structure or payment preimage requirements, but those are partially covered by schema descriptions and the 'paid' title. Overall, it is sufficient for an agent to understand what it will get and how to configure the condition.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds value beyond the schema by explaining metric-specific window requirements ('needs window 1h|24h|7d' for price_change_pct) and confirming the operator set. It also clarifies that all metrics are hourly-resolution counts. Schema coverage is 50% (window, preimage, payment_hash have descriptions), so the description compensates for missing semantics on metric, op, and value by providing context.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the action: 'Counts, at hourly resolution, how often a single condition became true in the trailing 90 days'. It specifies the resource (condition frequency) and scope (90-day trailing window), distinguishing it from sibling tools like btcmatic_radar which likely focuses on current conditions. The 'Past frequency, not a forecast' clarification removes ambiguity.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies historical analysis ('Past frequency') and warns against using it for predictions, but it does not explicitly say when to choose this over alternatives like btcmatic_radar or btcmatic_context. There is no direct comparison or exclusionary guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• btcmatic_topupA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must carry the behavioral burden. It states it's 'Free' and explains the redemption flow, but does not detail potential failure modes, expiry, or what happens if payment isn't claimed - though the core behavior is disclosed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three sentences, front-loaded with key fact 'Free', and no redundant or filler content. Every sentence adds useful information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given a single parameter, no output schema, and no annotations, the description covers the essential behavior, flow, and link to discovery tool. It could mention edge cases or expiration, but for a simple invoice minting tool it is fairly complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  With only one parameter and 0% schema coverage, the description doesn't explicitly explain amount_sats beyond referring to min/max via btcmatic_discover. It implies the amount is in satoshis but doesn't add much detail, though the simple schema plus reference to limits provides moderate base.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states the tool mints a Lightning invoice for a prepaid balance, which is a specific verb+resource action. It also references btcmatic_discover for min/max, distinguishing it from other btcmatic tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It explains the usage flow: pay with a wallet you control, then call btcmatic_topup_claim with the preimage. It clearly contrasts with the sibling claim tool and warns that the payment hash alone never yields a token, providing contextual guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• btcmatic_contextA
  4.1/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden. It discloses key behavioral aspects: stale data older than 5 minutes returns null, missing history is reported in data_quality (never interpolated), and the tool is 'Descriptive only.' These are valuable details that help the agent understand edge cases. It does not cover payment/auth requirements explicitly, but the 'paid' title and parameter names imply that, so the description adds meaningful context beyond the schema.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, concise and front-loaded. It lists the core data returned in the first sentence and important caveats in the second. No fluff or repetition—every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple market data tool, the description is complete. It enumerates all returned fields (price, changes, fee, percentile, mempool size) and explains data quality handling. There is no output schema, but the description sufficiently clarifies expectations. The tool is simple enough that no additional context is required.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, with each parameter (preimage and payment_hash) having a description. The tool description does not add additional parameter semantics beyond what the schema already provides. Since the schema covers all parameter meanings adequately, the baseline of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly specifies the tool's function: it returns the latest BTC price with 1h/24h/7d change, next-block fee percentile, and mempool size. This is a specific verb-resource pair that distinguishes it from sibling tools like btcmatic_discover (which likely focuses on discovery) and btcmatic_radar (radar-specific). The scope is unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage for retrieving current Bitcoin market context and states it is 'Descriptive only' (read-only). However, it does not explicitly mention when to use it vs. alternatives like btcmatic_radar or btcmatic_condition_frequency. The guidance is implicit through the tool's purpose, but no exclusions or comparisons are given, so it does not fully meet the bar for explicit usage guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• btcmatic_radarA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries behavioral disclosure. It explicitly states it costs one call, returns a 402 offer as data if unpaid, and clarifies that it only provides counts/labels, not verdicts. This adds meaningful behavioral context beyond what any schema would imply, though it does not explicitly state whether it is read-only.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is concise and well-structured: one sentence summarizing the data content, one sentence covering payment and failure behavior. No filler or redundancy, and the most important aspects (data type, payment requirement) are front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given there is no output schema, the description adequately covers what the tool returns (incidents, chatter counts, precision ledger) and the payment condition. It also implies how to satisfy payment (via preimage/payment_hash in schema). While not exhaustive, it is complete enough for an agent to understand the tool's purpose and invocation, especially with the 100% parameter documentation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so parameters are already documented. The tool description does not add additional meaning about parameters or their usage beyond what the schema provides. The baseline of 3 is appropriate because the schema carries the full burden and the description adds no extra value.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool provides a security radar snapshot: open/corroborated incidents, chatter counts with source counts, and a precision ledger. It distinguishes itself from siblings by focusing on security radar data and explicitly notes it returns counts/labels, not verdicts, which differentiates it from other btcmatic tools like discovery or context.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage context by stating what data it returns and that it's a paid snapshot, but it does not explicitly mention when to use it instead of sibling tools. It provides clear context on the tool's function, but lacks direct exclusions or alternative recommendations.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• btcmatic_discoverA
  4.4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  The description lacks explicit behavioral details beyond what it does. It mentions 'Free' but does not elaborate on side effects, rate limits, or other behavioral traits. With no annotations provided, the description carries the burden, but it does not go beyond a basic overview. However, it does add context on the payment flow, which is somewhat behavioral.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is highly concise, using a single sentence with key bullet points, and the imperative 'Call this first' is front-loaded. Every word earns its place, and it is structured effectively.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given that the tool is a discovery/informational endpoint with zero parameters and no output schema, the description covers the essentials: what is offered, cost, bounds, and flow. It is complete enough for the agent to invoke it without further clarification.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has 0 parameters, and the schema is empty, so the description is the only source of meaning. It adequately explains what the tool offers given that no parameters are needed. The baseline for zero parameters is 4, and the description meets it without unnecessary details.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states what the tool does: it provides an overview of the BTCMatic agent API, including costs, prepaid bounds, and payment flow. It distinguishes itself from siblings by positioning itself as the first call to understand the API's usage and economics.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Explicitly instructs to 'Call this first,' establishing a clear ordering relative to other tools. It also sets expectations for what information will be obtained (costs, bounds, payment flow), which guides the agent on when to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.