likely
Judge whether a claim about an email, comment, or diff is true, returning yes, no, or unsure with the model's probability when human fallback is allowed.
Instructions
Judge whether a claim is true of a text. Answers yes or no with the model's probability that the claim is true -- or unsure, when ask_human is set.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| lean | No | Which way to err when unsure is not allowed. | |
| stakes | No | How sure the model must be before an answer counts. Needs ask_human. | |
| subject | Yes | The text to judge: an email, a comment, a diff. | |
| question | Yes | A short claim about the text, e.g. "asks for a refund". Not an open question. | |
| ask_human | No | Allow the outcome `unsure` when the model cannot tell. Off by default. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||