validate_confidence
Check if your confidence is justified by assumptions: computes an honest ceiling, flags inflation, and verifies falsifiability.
Instructions
Check whether your claimed confidence is mathematically supported by your assumptions.
REQUIRED INPUT FORMAT — copy this structure exactly: {"assumptions":[{"description":"Redis will respond within 50ms under normal load","confidence":0.85,"falsification_condition":"Fails when Redis response time exceeds 50ms for >1% of requests in a 5-minute window"}],"response_text":"The full text of the response whose confidence you are validating"}
Each assumption needs: description, confidence (0.0-1.0), falsification_condition. If you cannot state a falsification_condition, set confidence to 0.3 or below.
Computes dependency-weighted honest confidence ceiling. Flags inflation when claimed confidence exceeds ceiling by >0.15. Checks falsifiability of stated conditions.
Optionally pass "context" with prior iteration data for escalation and stall detection.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| context | No | Optional caller-provided context for iterative enforcement. Include prior failure counts, iteration history, and previous response data to enable escalation and stall detection. Omit for one-shot usage. | |
| assumptions | Yes | Array of at least 1 assumption | |
| response_text | Yes | The response text being validated (min 10 characters) |