Skip to main content
Glama

Did the work meet the spec, criterion by criterion? Per-criterion pass / fail / undetermined, with an absent observation

v1_task_acceptance

Evaluate work against a spec criterion by criterion, returning pass, fail, or undetermined per criterion so missing observations are never counted as passes.

Instructions

Did the work meet the spec, criterion by criterion? Per-criterion pass / fail / undetermined, with an absent observation never counted as a pass (PAID $0.25)

Remote route: POST /v1/task/acceptance (0.25 USD x402/base/usdc on eip155:8453).

Input Schema

NameRequiredDescriptionDefault
specNoThe spec the work is judged against.
observedNo

Output Schema

NameRequiredDescriptionDefault
statusNo

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv1.0.0

TDQS

A3.6/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations cover the safety profile (not read-only, open-world, non-idempotent, non-destructive). The description adds genuinely new context: a $0.25 x402/USDC payment requirement, the remote POST route, and the semantic rule that an absent observation is never treated as a pass — which explains real output behavior.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the core question and output shape, followed by the payment/route line. No filler, though the parenthetical price duplicates the route line's cost figure.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

An output schema exists, so return-value explanation is rightly omitted. However, with all parameters optional (required=0) and a rich nested spec, the description never indicates how criteria are evaluated per kind or what tolerance means, leaving notable gaps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is only 50% and the spec is a nested object with id/kind/expected/tolerance left undocumented. The description clarifies the acceptance rule for the 'observed' side (absence ≠ pass) but says nothing about what 'kind' or 'tolerance' should contain.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific judgment: does the work meet the spec, per criterion, yielding pass/fail/undetermined. That framing is distinguishable from generic verdict siblings like v1_verdict_tool or v1_output_verify, though it never explicitly names or contrasts those alternatives.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The question form ('Did the work meet the spec?') implies the use case — acceptance-checking deliverable against criteria — but there is no explicit when-to-use/when-not-to-use statement and no routing guidance among the many verdict/verify siblings.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Deploy Server

Other Tools