Audit extracted values against their source text
jev_auditAudit extracted values against their claimed source text to catch hallucinations, off-target or incomplete data, wrong formats, and omissions before trusting them.
Instructions
Audit extracted values against the text they claim to come from, before the values are trusted: one request with a per-value failure-mode battery (hallucinated / off-target / incomplete / wrong format, each framed so true = something is wrong) plus a dedicated omission check for empty values. Any value's P(wrong) at wrong_at escalates the whole audit; max-gated, never averaged. For multimodal intake: run your vision or ASR model first to produce a dense transcript of the image, scan, or recording, screen that transcript with jev_screen, then audit the extracted values against it here — the tool never sees pixels or audio, it audits two text artifacts against each other. Schema validation catches structural errors; it can flag a schema-valid fabrication against the supplied source text — a limited cross-check, not verification of the original.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| source | Yes | The text the values claim to come from: a document, or the dense transcript a vision or ASR model produced. Truncated at 50,000 chars. | |
| records | Yes | Extracted values to audit against the source. Up to 32 per call. | |
| wrong_at | No | A record's P(wrong) at or above this flags the value and escalates. Default 0.7. |