find_unsupported_words
Find words in an answer that the least sources support and pair each with the closest matching evidence from the source texts, letting reviewers judge possible hallucinations.
Instructions
Given an answer and the sources it was supposedly drawn from, return the words the sources least support, each paired with the closest thing in the sources.
Numbers are checked by arithmetic, not by meaning: a value is present or it is not, and formatting is normalised first, so 10,000 and 10000 and $10,000 are one number. Words are checked by embedding similarity.
Returns evidence for a human to judge. It does NOT return a verdict on whether the answer is hallucinated, and there is no threshold to compare the floor to. Report the weakest anchors and let the reader decide.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| k | No | ||
| answer | Yes | ||
| locale | No | und | |
| sources | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||