Server Quality Checklist

Tool Scores

• task_submissionsA
  3.6/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. It discloses a key behavioral trait via 'own wallet view for winner_only visibility', informing potential access restrictions. However, it does not explicitly state that the operation is read-only, what is returned, or any error/edge-case behavior, leaving some gaps.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, front-loaded sentence: 'List submissions for a Taskmarket task' followed by a parenthetical scope note. Every word earns its place, and there is no redundant phrasing or filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness2/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  With no output schema and no annotations, the description should explain return values or behavior, but it does not. It omits what the list of submissions contains (e.g., IDs, statuses), pagination, ordering, or what happens if the caller is not the winner. The parenthetical gives some context but leaves significant gaps for a simple list operation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The only parameter, task_id, is already fully described in the schema as a '0x-prefixed 32-byte task ID' (100% coverage). The description adds no new parameter semantics beyond what the schema provides, so the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose4/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool lists submissions for a Taskmarket task, using a specific verb and resource. The parenthetical 'own wallet view for winner_only visibility' adds a scope constraint, which helps distinguish it from siblings like task_pitches or task_proofs, though it does not explicitly name alternatives.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context: this tool is for listing submissions for a specific task, with the caveat that visibility depends on the wallet and winner status. It does not mention exclusions or alternatives, but the purpose is unambiguous enough for an agent to infer when to use it.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• wallet_balanceA
  3.8/5.0
  Behavior2/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden for behavioral disclosure. It only states that the tool 'Show[s] USDC balance' and does not mention whether this is a read-only operation, if it requires any network access, or what happens if the address is invalid. The read-only nature is implied by 'Show' but not explicitly stated, and no other behavioral traits are disclosed.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, short sentence (15 words) that is front-loaded with the action ('Show') and resource ('USDC balance'). Every word contributes meaning with no redundancy or filler.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple tool with one optional parameter and no output schema, the description adequately conveys the main function and return value (a USDC balance). It lacks any note on edge cases or response formatting, but these are not critical for such a straightforward operation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already fully documents the optional parameter 'address' with a clear description. The tool description adds a hint about the '--address' flag but does not provide additional semantics beyond what the schema offers. Baseline 3 is appropriate since schema coverage is 100%.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb ('Show') and clearly identifies the resource ('USDC balance') and the target ('local worker wallet', with an optional address override). This clearly distinguishes it from sibling tools like wallet_address (which likely returns the address) and task_* tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly establishes the context for using this tool: to display the USDC balance of the local wallet or a specific address. It doesn't explicitly mention alternatives, but the purpose is unambiguous and no exclusions are needed given the simplicity and sibling separation.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• task_createA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the transparency burden. It discloses a key side effect: the task is funded from the agent wallet in Base USDC. However, it doesn't explain the timing of the deduction, potential reversibility, or what the tool returns.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is three concise sentences with the action front-loaded. Every sentence adds necessary context: creation, funding source, and required/optional parameters. No filler or redundancy.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the absence of an output schema and annotations, the description covers the essential aspects well: creation, funding, required parameters, and optional mode. The only notable gap is not stating what the tool returns, but the coverage is otherwise solid.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  All five parameters are fully described in the schema (100% coverage). The description adds minimal semantic value beyond restating that reward is in USDC and duration is in hours, so the baseline score of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the verb 'Create' and the resource 'Taskmarket bounty task', and further specifies funding from the agent wallet in Base USDC. This uniquely distinguishes it from sibling tools like task_get and task_submit, which operate on existing tasks.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implies clear usage: create a new task when you need to launch a bounty or other task mode. It doesn't explicitly contrast with alternatives, but the creation-focused verb and required parameters make the context obvious.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• task_getA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must disclose behavior. It states the read-only nature ('Fetch') and lists the returned fields, which is useful. But it doesn't mention error handling, permissions, or any side effects—though none are likely for a getter.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, focused sentence. It front-loads the action and resource, then lists the return fields. No wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple one-parameter fetch tool, the description adequately explains what is returned (listing fields) and the input. It lacks explicit failure behavior, but that's a minor gap given the tool's simplicity.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The input schema already describes task_id with full detail ('0x-prefixed 32-byte task ID'), and the description repeats this without adding new parameter semantics. Since schema coverage is 100%, baseline 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses a specific verb 'Fetch' and identifies the exact resource ('full details for one Taskmarket task by 0x task ID'). It enumerates the returned fields (status, reward, deadline, etc.), which clearly differentiates it from sibling tools like task_browse or task_submissions.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description conveys that this is for fetching a single task by ID, which implies its use case. However, it does not explicitly mention alternatives or when not to use it, so it stops short of a 5.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• task_pitchesA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries full burden for behavioral disclosure. It implies a read operation via 'List', but does not disclose any additional behaviors such as error conditions (e.g., when task is not in pitch mode) or return format. It is minimally sufficient but lacks deeper context.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is one concise, front-loaded sentence that efficiently communicates the tool's purpose. Every word contributes meaning, with no unnecessary elaboration.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the tool's simplicity (one parameter, no output schema, no annotations), the description is nearly complete. It covers what the tool does, the condition for use (pitch-mode tasks), and implies read-only behavior. It could mention the return value type, but this is not critical for a straightforward list operation.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema already provides a complete description of the single parameter (task_id as a 0x-prefixed 32-byte string). The tool description adds no further meaning about the parameter, so baseline of 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool's function: listing pitches for a pitch-mode task. The verb 'List' is specific, the resource 'pitches' is distinct from sibling tools like task_get or task_submissions, and the qualifier 'pitch-mode Taskmarket task' distinguishes its scope.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description implicitly provides usage context by specifying 'for a pitch-mode Taskmarket task', indicating when this tool applies. It does not explicitly mention alternatives or exclusions, but the context is clear enough for an agent to select it appropriately among siblings that handle different resource types.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• task_proofsA
  4/5.0
  Behavior3/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description carries the burden of disclosing behavior. 'List' implies a read-only operation, but the description does not add details about side effects, return format, or any requirements beyond the task_id parameter. It is safe but minimal.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single sentence, immediately starts with the verb 'List', and contains no wasted words. It is perfectly concise and front-loaded.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  The tool is simple with one parameter fully described in the schema. The description says what it does and for what context. While there is no output schema, a list operation's purpose is clear enough without additional detail.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema covers 100% of the parameter with a clear description ('0x-prefixed 32-byte task ID'). The tool description adds no extra parameter semantics, so baseline 3 is appropriate.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description uses the specific verb 'List' with a clear resource 'benchmark proofs' and scope 'for a benchmark-mode Taskmarket task.' This clearly distinguishes it from sibling tools like task_submissions or task_get.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides explicit context that this tool is for benchmark-mode tasks, giving a clear indication of when to use it. It does not explicitly mention alternatives or exclusions, but the context is specific enough.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• task_browseA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations provided, the description carries the full burden. It usefully discloses return fields and the key detail that reward is already divided by 1e6. It does not mention pagination behavior or explicitly confirm read-only use, but the verb 'browse' implies a safe read operation.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two sentences, front-loaded with the primary purpose, then efficiently covers return value details and filter options. No wasted words.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given 8 parameters, no output schema, and no annotations, the description adequately covers the core purpose, return fields, and available filters. It omits pagination/cursor behavior and default limits, but these are secondary for a browse tool and partially inferable from the schema.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The schema covers 100% of parameters with descriptions, so the baseline is 3. The description only paraphrases the filter parameters (modes, tags, reward range) and adds no new syntax or format details beyond what the schema already includes. The USDC division detail pertains to return values, not parameters.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description opens with 'Browse open Taskmarket tasks', a specific verb and resource, and lists the return fields (task ID, title, reward, status, submission count, deadline). This clearly distinguishes it from sibling tools like task_get (retrieve one task) and task_create (create a task).

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description clearly implies this tool is for browsing/listing tasks, with filtering by mode, tags, and reward range. However, it does not explicitly state when not to use it or name alternative tools (e.g., 'use task_get for a single task'), so it lacks explicit exclusion guidance.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• task_submitA
  4.2/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  With no annotations, the description must bear the burden of behavior disclosure. It reveals a significant behavioral trait: free submissions are allowed up to 5 per task, and paid submissions require explicit user authorization. This goes beyond the schema, though it doesn't cover return values or side effects like payment execution.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is two concise sentences that front-load the purpose and then add essential usage conditions. No wasted words; every clause adds value.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  Given the simple schema (2 required parameters, no output schema), the description covers the main purpose, file parameter usage, and a critical authorization caveat. It doesn't explain what happens after submission (e.g., return of a submission ID), but for a submission tool with this simplicity, it is reasonably complete.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters3/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  Schema description coverage is 100% for the two parameters, with clear descriptions for task_id and files. The description adds only a minor hint about repeating --file for multiple artifacts, which is already implied by the array type in the schema. Baseline 3 applies.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states 'Submit work to a Taskmarket task,' using a specific verb and resource. This distinguishes it from siblings like task_get, task_create, and task_browse, which are retrieval or creation tools.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context (submitting completed work) and a key usage condition: 'Requires explicit user authorization for any paid submission (after the 5 free submissions per task).' It doesn't explicitly mention alternatives, but the context is sufficient to infer when to use this tool versus siblings.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

• wallet_addressA
  4.4/5.0
  Behavior4/5

  Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

  No annotations are provided, so the description carries the full burden. The verb 'Print' clearly signals a read-only operation with no side effects, and the description adds useful context about the wallet address being tied to the local CLI. It doesn't specify return format or potential errors, but for a simple print tool this is acceptable.

  Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

  Conciseness5/5

  Is the description appropriately sized, front-loaded, and free of redundancy?

  The description is a single, concise sentence that directly states the tool's function without unnecessary details or repetition.

  Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

  Completeness4/5

  Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

  For a simple parameterless tool with no annotations or output schema, the description fully explains what the tool does and the context (local CLI). It doesn't describe the return format, but that's a minor gap given the simplicity and the clear 'Print' action.

  Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

  Parameters4/5

  Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

  The tool has zero parameters, and the schema coverage is 100% (empty). The baseline for 0 params is 4, and the description doesn't need to explain parameter semantics since there are none.

  Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

  Purpose5/5

  Does the description clearly state what the tool does and how it differs from similar tools?

  The description clearly states the tool prints the Taskmarket worker wallet address used by the local CLI. The verb 'Print' and specific resource 'Taskmarket worker wallet address' make the purpose unambiguous and distinguish it from sibling tools like wallet_balance.

  Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

  Usage Guidelines4/5

  Does the description explain when to use this tool, when not to, or what alternatives exist?

  The description provides clear context ('used by the local CLI') that implies when to use the tool. It doesn't explicitly mention alternatives or exclusions, but the purpose is specific enough that an agent can infer when it applies.

  Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.