Skip to main content
Glama

Check one answer's grounding

check_answer_grounding

Verify an answer is grounded in provided context by checking required facts, number traceability, and proper abstention for unanswerable questions. Returns pass/fail with named issues.

Instructions

Deterministically check a single answer against the context it should be grounded in: required facts (anchors) present, every number traceable to the context, abstention when the question is unanswerable. Same logic as the CI gate — no model, no network. Returns pass/fail with named issues.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
answerYesThe answer to check
contextYesThe retrieved passage(s) the answer must be grounded in
questionYesThe question that was asked
answerableNofalse → the context cannot answer this; the only correct behaviour is abstention
answer_anchorsNoFacts a correct answer MUST contain (with acceptable rephrasings)
abstain_markersNoPhrases that count as a valid refusal (defaults cover common forms)
allowed_new_numbersNoNumbers legitimately absent from the context (e.g. computed totals)

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observedv0.4.0

TDQS

A3.8/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations provided, the description carries the full burden of behavioral disclosure. It clearly states that the tool is deterministic, requires no model or network, and returns pass/fail with named issues. It also reveals key validation behaviors around anchors, numbers, and abstention, which goes well beyond a bare description.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single dense sentence with no filler. It front-loads the tool's core purpose, then lists the specific checks and the deterministic/offline nature, with return behavior stated at the end. Every clause earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description covers what the tool validates, that it is deterministic and offline, and what it returns (pass/fail with named issues). With no output schema present, this is sufficient for an agent to understand the tool's behavior. Minor gaps are the absence of explicit usage examples or edge-case notes, but the overall context is adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so the baseline is 3. The description references anchors, traceable numbers, and abstention, which loosely map to answer_anchors, allowed_new_numbers, and answerable/abstain_markers, but it does not add much parameter-specific meaning beyond what the schema already documents.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb and resource ('check a single answer against the context') and enumerates precise checks: anchors present, numbers traceable, abstention when unanswerable. It clearly identifies the tool's function, though it does not explicitly differentiate it from sibling check tools like check_extraction or check_readiness.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description gives useful context ('Same logic as the CI gate — no model, no network'), implying use when a deterministic, offline check is needed. However, it does not explicitly state when to prefer this tool over alternatives or when not to use it.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.