check_hallucination_risk
Estimate hallucination risk in AI agent outputs by checking grounding against source text, or flagging outputs with excessive specific numbers, dates, and URLs.
Instructions
Estimate hallucination likelihood in agent output. If source text is provided, checks grounding. Otherwise flags outputs with high counts of specific numbers, dates, and URLs.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| output | Yes | The agent output text to analyze | |
| claim_count | No | Threshold for number of specific claims before flagging as high risk (default 5) | |
| source_text | No | Original source material the output should be grounded in (optional) |