Server Quality Checklist

Tool Scores

• estimate_transaction_costA
  3.5/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden. It states the tool 'estimates' cost, implying a non-destructive, non-committal operation. However, it does not disclose whether the estimate is based on real-time data, how often it updates, or any assumptions made. The description is minimally transparent but lacks behavioral depth.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that efficiently encapsulates the tool's purpose, including the list of actions and the tier option. It is front-loaded with the verb and resource, and contains no redundant information. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness3/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The description explains the input parameters well but omits any description of the output format or behavior (e.g., returns a numeric USD value, may be based on current gas price). Without an output schema, the agent is left guessing about the return value. For a tool with 3 parameters and no output schema, the description is adequate but not fully complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100%, so the schema already documents each parameter (action enum, gas_units, tier with default). The description restates the action examples and tier concept but does not add new semantic meaning beyond what the schema provides. Baseline 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb ('estimate'), the resource ('USD gas cost'), and specifies the scope ('specific Ethereum mainnet action' with examples and custom option). It effectively distinguishes from siblings like 'get_current_gas' (which likely provides raw gas price) and 'get_eth_price' (which provides ETH price).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines2/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description does not provide any guidance on when to use this tool versus its siblings. For example, it doesn't clarify that this tool should be used for cost estimation of a specific transaction while 'best_time_to_transact' is for timing or 'get_l2_gas' for layer-2 costs. There is no context about prerequisites or limitations.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_eth_priceA
  3.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must disclose behavioral traits. It only states what it returns, not whether it is read-only, network-dependent, rate-limited, or how fresh the data is. This is minimal transparency for a data-fetching tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence that is both concise and front-loaded. It contains no fluff and every word serves a purpose, efficiently conveying the tool's function.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool has zero parameters and no output schema, the description is nearly complete. It specifies the return data types (price and change), but could be improved by noting the structure (e.g., an object with specific fields) or data freshness, though this is not critical.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema has zero parameters, so there is no parameter information to add. The description compensates by clearly stating the output (price and 24h change). With no parameters, the baseline is high, and the description meets it.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool gets the current ETH/USD spot price and its 24-hour change. It uses a specific verb ('Get') and resource ('current ETH/USD spot price'), and it is distinct from sibling tools which deal with gas, transaction costs, and timing.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description does not provide explicit guidance on when to use this tool versus alternatives. While the sibling tools have different focuses (gas prices, etc.), the description lacks when-to-use/when-not-to-use context, leaving it to the agent to infer.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• best_time_to_transactA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description must bear the burden. It explains what the tool returns but does not disclose any behavioral traits such as idempotency, data source staleness, or rate limits.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, well-structured sentence that conveys all essential information without redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no output schema, the description explains the return values adequately. It could be more explicit about the format or units of savings, but it is sufficient for a simple tool.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so the description need not add parameter detail. It adds value by explaining the return content beyond the empty schema.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's purpose: to determine whether to send a transaction now or wait, and it lists specific outputs (recommendation, expected savings, next cheaper gas window). It distinguishes from siblings like get_current_gas and estimate_transaction_cost by focusing on timing optimization.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines3/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies usage when deciding transaction timing but does not explicitly contrast with siblings or provide when-not-to-use guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_current_gasA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It discloses the exact outputs (gas prices, ETH/USD, recommendation). However, it does not mention data freshness, source, or any limitations (e.g., mainnet only, potential caching). Still, it is mostly transparent for a simple read tool.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description consists of two concise sentences. The first states the purpose, the second gives a use case example. No wasted words, and information is front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given no parameters, no output schema, and no annotations, the description is fairly complete. It covers what the tool returns and when to use it. It could mention that it is for Ethereum mainnet only (though implied) and any refresh policy, but overall it is sufficient.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so baseline is 4. The description adds meaning beyond the empty input schema by explaining the returned data, which is valuable for an agent.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool retrieves current Ethereum mainnet gas price (low/average/high in Gwei), live ETH/USD price, and a send-now-vs-wait recommendation. This specific verb+resource differentiates it from siblings like get_eth_price (ETH price only) and get_l2_gas (L2 gas).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly says to use this tool to answer 'what is the gas fee right now', providing a clear use case. It does not explicitly mention when not to use or alternatives, but the sibling context implies differentiation. A slight improvement would be to exclude other cases.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• get_l2_gasA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries full burden. It describes the tool as comparing live fees and identifying the cheapest, implying a read-only data retrieval. No side effects are mentioned, but for a simple data tool this is sufficient.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  Two concise sentences with no wasted words. The first sentence states the core functionality, the second clarifies use cases. Every word earns its place.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a no-parameter tool with no output schema, the description adequately covers purpose and usage. It could mention the return format, but the context is sufficient for an agent to invoke correctly.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, so baseline is 4. The description does not add parameter info because there are none. The schema coverage is 100% (empty), so no further compensation needed.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool compares live L2 gas fees across four specified chains, identifies the cheapest, and is intended for 'cheapest L2' or 'L2 gas fees' questions. It uses a specific verb ('compare') and resource ('L2 gas fees') and distinguishes itself from sibling tools like get_current_gas (likely L1) and estimate_transaction_cost.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description explicitly states when to use the tool: for 'cheapest L2' / 'L2 gas fees' questions. While it does not list exclusions, the context is clear enough given sibling tools cover other gas-related queries.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.