Check one answer's grounding
check_answer_groundingVerify an answer is grounded in provided context by checking required facts, number traceability, and proper abstention for unanswerable questions. Returns pass/fail with named issues.
Instructions
Deterministically check a single answer against the context it should be grounded in: required facts (anchors) present, every number traceable to the context, abstention when the question is unanswerable. Same logic as the CI gate — no model, no network. Returns pass/fail with named issues.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| answer | Yes | The answer to check | |
| context | Yes | The retrieved passage(s) the answer must be grounded in | |
| question | Yes | The question that was asked | |
| answerable | No | false → the context cannot answer this; the only correct behaviour is abstention | |
| answer_anchors | No | Facts a correct answer MUST contain (with acceptable rephrasings) | |
| abstain_markers | No | Phrases that count as a valid refusal (defaults cover common forms) | |
| allowed_new_numbers | No | Numbers legitimately absent from the context (e.g. computed totals) |