Server Quality Checklist

Tool Scores

• build_swapB
  3.2/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of disclosure. It discloses a key behavioral trait: the output is unsigned and signing happens client-side, never on the server. However, it does not mention potential errors, return format, or other side effects, leaving gaps in transparency.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is extremely concise, with exactly two sentences: one stating the core purpose and one delivering a critical security warning. Every word earns its place, and the most important information is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given that there is no output schema and no annotations, the description is too sparse. It explains what the tool does and mentions signing, but does not describe the return value structure, any prerequisites (e.g., how to obtain a quote), or possible failure modes. This is insufficient for an agent to fully understand the tool's behavior.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters2/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is low (33%), and the description only clarifies the role of quote_id (from get_quote). It does not explain user_address or api_key beyond what the schema provides, nor does it compensate for the lack of documentation on the two required parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly identifies the tool as generating an unsigned transaction group for a given get_quote quote_id, distinguishing it from sibling tools like get_quote or pay_x402_invoice. However, it lacks an explicit verb like 'build' or 'create', making the action slightly implicit.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description gives implicit usage context (use after obtaining a quote) and provides clear instructions on signing and submitting the group. It does not explicitly state when to use this tool versus alternatives, nor does it mention any prerequisites or exclusions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_balanceB
  3.4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the full burden of disclosing behavior. The phrase 'Current balance' implies a read-only operation, but it does not explicitly state that it has no side effects, nor does it mention api key validity or error behavior. It provides minimal but acceptable transparency for a simple getter.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence with no wasted words. It conveys the essential information efficiently.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple balance-check tool with one optional parameter and no output schema, the description is adequate. It identifies the resource (credit balance) and the scope (API key). It could mention the return format, but that is not critical for a straightforward getter.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema covers the single parameter (api_key) with a description, and the tool description's reference to 'your API key' is redundant with the schema. With 100% schema coverage, the baseline of 3 applies, and the description adds no extra semantics.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool returns the current HOGSWAP credit balance for the API key, which is a specific resource and action. It is implicit that this is a retrieval operation, and it is distinct from siblings like get_quote or build_swap, though it doesn't explicitly name alternatives.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides no guidance on when to use this tool versus alternatives, no prerequisites, and no exclusion criteria. It is a bare statement of functionality without usage context.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• verify_registrationA
  3.9/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full responsibility. It explicitly discloses that the key is returned only once, is not recoverable, and is not stored by the server—critical behavior that prevents misuse or false expectations.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences with no filler. It front-loads the purpose and immediately delivers essential warnings about key retrievability, making every word earn its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description focuses on output behavior (one-time key, not recoverable) but ignores input requirements—what the address, challenge, and signature_b64 are and how to obtain them. Without an output schema or annotations, this leaves significant gaps for a 3-parameter tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters1/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is only 33% (only signature_b64 is described). The description text adds no meaning for the address or challenge parameters, failing to compensate for the low coverage and leaving users guessing about what these inputs are.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states this is step 2 of self-service key issuance and that it returns the hsk_ API key, giving a specific verb and resource. It distinguishes itself from sibling tools by its role as the final key-return step.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides useful context by labeling the tool as 'step 2 of 2,' implying it follows a prior step, and warns that the key is shown only once. However, it does not explicitly name when to use this vs. alternatives or state prerequisites like needing a challenge from step 1.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_quoteA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  Since no annotations are provided, the description must disclose behavioral details, and it does: amounts are in base units (µ), asset 0 = ALGO, and the two modes are exact-in or exact-out with minimum input solved. It stops short of stating side-effect freedom or error cases, but for a quote tool this is a solid disclosure.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is only three sentences, each with a distinct purpose: scope, input modes, and output. It is front-loaded with the tool's main purpose and contains no filler or redundant information.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With no output schema, the description adequately covers the return values (expected_out, route legs, quote_id) and the core usage modes. It doesn't explicitly state that exactly one of amount/amount_out is required, but the 'OR' and examples imply it. For a routing quote tool of moderate complexity, this is reasonably complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so the baseline is 3. The description adds meaning beyond schema by clarifying that amount and amount_out are alternative modes ('Give amount OR amount_out'), explaining base units, and linking the quote_id to build_swap. This exceeds the schema's per-field descriptions.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool fetches a HOGSWAP swap quote across every Algorand DEX, with a specific verb ('get quote') and scope. It distinguishes itself from siblings like build_swap by mentioning it returns a quote_id for later swap execution, making its role unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly explains the two usage modes: exact input (amount) and exact output (amount_out), and notes that exact-out solves for minimum input. It connects to the downstream sibling build_swap via quote_id, providing clear context. It doesn't explicitly name alternatives or exclusions, but the mode selection and downstream linkage are strong guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_credit_offerA
  4.5/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description fully carries the transparency burden. It discloses the non-obvious HTTP 402 behavior, describes that accepts[0] is an invoice, instructs to keep the note, and explains credit settlement timing (~1 block after payment). This is rich, useful behavioral context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Three concise sentences front-load the main action, then provide critical behavioral details. Every sentence adds value with no fluff or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Even without an output schema, the description explains the key response elements (accepts[0], the note), the unusual HTTP 402 semantics, and the post-payment timeline. It gives the agent enough to successfully invoke the tool and understand what to do with the result.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema coverage is 100%, so both parameters (api_key and usdc_micro) are already described in the schema. The description does not add additional parameter-level detail beyond what the schema provides, so the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description states a specific verb+resource: 'Create a credit top-up and get the x402 offer'. It clearly distinguishes this tool from siblings like get_quote or build_swap by focusing on the credit top-up and offer process.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  Clearly indicates the tool is used to create a top-up and obtain an offer, then directs the agent to feed the result into pay_x402_invoice. It gives clear context, though it does not explicitly mention alternatives or exclusions compared to sibling tools.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• list_payable_assetsA
  4.5/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the behavioral disclosure burden. It discloses the dynamic nature of the list ('price-confidence gated') and guarantees certain entries ('ALGO and USDC always included'). It also prevents false expectations by clarifying that metadata is not part of this response. It does not explicitly state read-only behavior, but the verb 'list' implicitly conveys this.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, about 35 words, and immediately front-loads the core purpose. The second sentence adds valuable cross-reference for metadata without redundancy. Every word earns its place; no filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple no-argument list tool, this description is complete: it states what the list includes, the gating behavior, the guaranteed entries, and where to retrieve metadata if needed. There is no output schema, but the description compensates by clarifying the nature of the response. The agent can confidently select and invoke this tool with no ambiguity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the input schema is vacuous. Per the rubric, 0 params receives a baseline score of 4. The description adds context about what the returned list represents, but no parameter-specific guidance is needed. It appropriately references where to find metadata, which helps the agent understand the tool's output semantics.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly defines the resource and scope: 'Assets accepted as payment inputs for pay_x402_invoice and credit top-ups.' This uses a specific verb (implicitly 'list') and distinguishes it from siblings such as get_balance or get_quote. The qualifiers 'price-confidence gated' and 'ALGO and USDC always included' further specify the exact set.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies when to use the tool: to discover which assets are accepted for specific payment flows. It also provides a clear pointer for when not to use it: 'Asset metadata is on get_quote responses or GET /assets.' However, it does not explicitly name alternative tools for the same listing purpose or state 'use this when...' explicitly, so it falls short of a perfect 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• pay_x402_invoiceA
  4.8/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description fully carries the behavioral disclosure burden. It reveals return format ('Returns UNSIGNED groups'), execution order ('sign everything in one pass, then submit the groups IN ORDER'), special handling ('if you already hold the demanded asset it is a single direct payment'), and a critical security warning ('NEVER pass mnemonics or private keys to any tool'). This is exceptionally transparent.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is dense but every sentence earns its place, covering purpose, usage, behavioral details, limitations, and security in a compact paragraph. It is front-loaded with the core action and structured logically from what to pass to what to expect.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the complexity (nested invoice and inputs objects, no output schema), the description covers return behavior, signing and submission order, special cases (HOGSWAP top-ups, holding no demanded asset), and constraints (max 4 inputs, EVM not supported). It is complete enough for an agent to invoke correctly without additional context.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters5/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The description adds meaning beyond the schema: it explains that `invoice` is the accepts entry from the 402 response, that a single `input` with no amount solves the minimum, that `inputs` can be any routable assets you hold even if not the demanded one, and that `api_key` is an override. With only 50% schema coverage, this fully compensates.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with 'Pay ANY Algorand-settled x402 invoice with any 1-4 routable assets you hold' – a specific verb, resource, and scope that clearly distinguishes it from siblings like get_quote or build_swap. It also states what it does not do ('EVM-settled invoices are not supported'), further differentiating it.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides explicit context: 'Pass the accepts entry you picked from the 402 response as invoice' and notes it works for HOGSWAP top-ups. It gives an exclusion for EVM invoices but doesn't explicitly name alternative tools for when not to use this one, leaving a slight gap in direct sibling comparison.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• register_agentA
  4.8/5.0
  Behavior5/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description fully carries the behavioral disclosure burden. It explains the two-step challenge-response flow, that signing occurs off-server, and includes a critical security warning about secret handling—going well beyond the minimal schema.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness4/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is front-loaded with its purpose and is largely concise, but the final sentence partially restates the 'own wallet tooling' point from the second sentence, creating minor redundancy that prevents a perfect score.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness5/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Even without an output schema, the description explains the return value (challenge string), the required next step (verify_registration), and security boundaries, fully covering the tool's context given its simple one-parameter design.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already fully describes the address parameter (100% coverage). The description adds that the address's key is used for signing, reinforcing its purpose and binding semantics, though this is only marginally adds to the schema's 'bind the key to' phrasing.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states this is the first step of self-service HOGSWAP API key registration ('step 1 of 2', 'Returns a challenge string'), distinguishing it from the sibling verify_registration and making the tool's exact function unambiguous.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines5/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  It provides explicit workflow guidance: sign the challenge 'IN YOUR OWN wallet tooling' then 'call verify_registration', and explicitly warns against passing mnemonics/private keys, giving clear when-to-use and when-not-to-use instructions.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.