Skip to main content
Glama

Grade an answer

grade

Review Leanfare delegate answers and plan parts, assign good/partly/wrong verdicts, and repair flawed results before using them in a response.

Instructions

Review every answer Leanfare brings back (delegate, or a plan's part from plan_status) before you use it, then say how good it was: good, partly or wrong. Grade a delegate answer with handoff (the number in its receipt); a plan's part with id and part. If it is partly or wrong, fix it before you answer the user: yourself (fix myself), or with fix leanfare and why, and Leanfare asks again one tier up and returns the new answer, a new hand off to review and grade too. Leanfare keeps only the grade, with the model that answered and the kind of part, never the words; why goes only to the model asked again. A model graded below good too often for a kind is moved down, so plans and delegate stop picking it for that kind. At the end of a prompt that handed work off, grade its whole result too, your work and the hand offs together: whole true and the verdict.

Input Schema

NameRequiredDescriptionDefault
idNoThe plan's id, from plan.
fixNoWith partly or wrong. myself: you fixed it yourself before answering. leanfare: Leanfare asks again one tier up, with why, by another model, and returns the new answer.
whyNoWith fix leanfare: what was wrong or missing, in a line or two. It goes to the model asked again, and is not kept.
kindNoFor a delegate answer: the kind you gave it.
partNoThe part's number in the plan.
modelNoFor a delegate answer: the model id its receipt named, such as deepseek/deepseek-v4-flash.
wholeNotrue: grade the final result of the prompt you are on, your own work and Leanfare's parts together (once, at the end of a prompt that handed work off). Only the verdict is needed with it.
checksNoWith id: the project's checks you ran once the plan's parts were back, by their numbers in the plan (passed and failed), and why in a line for a failure.
handoffNoFor a delegate answer: the hand off's number, from its receipt. Enough on its own.
verdictYesgood: you used it as it was. partly: you had to fix or redo some of it. wrong: you could not use it.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.15.1

TDQS

A4/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Well beyond the annotations, it discloses exactly what is persisted ('Leanfare keeps only the grade, with the model that answered and the kind of part, never the words'), where 'why' goes ('only to the model asked again'), and a real system side effect ('A model graded below good too often for a kind is moved down, so plans and delegate stop picking it for that kind'). It also warns that fix leanfare spawns another round producing 'a new hand off to review and grade too', which is essential for an agent to avoid a loop. The annotations only mark it as a non-idempotent write, so this text carries the substantive burden.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The core instruction is front-loaded, which is good, but the body is a single dense run-on chain of sentences with ambiguous referents ('a new hand off to review and grade too') and repetitive restatement of the fix loop. Every clause carries information, yet the compressed grammar forces re-reading, so it is information-dense rather than concise.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 10-parameter, nested-object tool with no output schema, the description covers the workflow, persistence, consequence and the whole-result case — far more than most. It is still silent on what a plain grade (without fix) returns and on error behaviour, which an agent would need to confirm success, so it falls short of fully complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already documents every parameter, including enums and the nested checks object — that sets the baseline at 3. The description does add one genuinely useful routing rule beyond the schema ('grade a delegate answer with handoff; a plan's part with id and part'), which is a slight lift, but it never clarifies the model/kind pairing or when checks must be supplied, so it does not fully transcend the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb+resource ('Review every answer... then say how good it was: good, partly or wrong') and identifies exactly which artifacts it grades: 'delegate, or a plan's part from plan_status'. That implicitly separates it from siblings like delegate, plan_status and report. It loses a point because the jargon-heavy, clipped phrasing ('a hand off', 'one tier up') makes the core purpose take a couple of passes to parse.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives a clear use rule ('Review every answer Leanfare brings back before you use it') and a separate trigger for the whole-result case ('At the end of a prompt that handed work off, grade its whole result too'). It also routes the agent on each verdict (if partly/wrong, fix myself or use fix leanfare with why). No alternatives are named, but for a terminal grading step there are no comparable siblings, so the absence is minor.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.