Verify claims against evidence
verify_claimCheck if your evidence actually supports each claim before you state, cite, or act on it. Returns verified, contradicted, unsupported, or fabricated verdicts with probabilities and confidence.
Instructions
Check whether supplied evidence actually supports claims you are about to state or act on. Returns a verdict and probabilities per claim, never prose.
WHEN TO USE: before reporting work as complete or a bug as fixed, before stating a root cause, before citing a source, or before building the next step on something you concluded earlier. Pass the claim and the raw evidence you believe backs it.
WHAT TO PASS: "evidence" is the actual material (test output, diff, log, document text), and "claims" are the specific statements to check against it. Several claims about the same evidence go in one call. Add "quote" when you attribute exact words to the evidence.
HOW TO READ THE RESULT, per claim:
verified: the evidence states or directly implies the claim.
contradicted: the evidence says the opposite. Retract or fix the claim.
unsupported: the evidence does not address the claim either way. The claim may still be true, but this evidence does not show it; find evidence that does.
fabricated: the "quote" is not in the evidence. Decided by string match with no model call, so "probabilities", "confidence", and "certainty" are null.
"probabilities" covers supports / contradicts / says_nothing. "confidence" (0-1) says how concentrated that distribution is, and "certainty" (high/medium/low) applies the thresholds to it.
"needs_escalation" lists claim ids whose verdict has low certainty. Do not treat those as settled, including a low-certainty "verified": get more direct evidence, check it yourself, or tell the user the claim is unconfirmed. A verdict only covers the evidence you passed; it cannot notice evidence you left out.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| claims | Yes | ||
| evidence | Yes | The source material itself: test output, a diff, a log, a document section, fetched page text. Not your summary of it. The model judges the claim against this and nothing else. | |
| thresholds | No | Override the uncertainty thresholds for this call. Tighten them (e.g. confidence_high 0.9, noul_band [0.1, 0.9]) when acting on a wrong answer would be costly or irreversible. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | ||
| usage | Yes | ||
| verdicts | Yes | ||
| needs_escalation | Yes |