calibration_score
Evaluate prediction calibration using Brier score, accuracy, and confidence breakdown. Filter by domain and lookback period to track calibration over time.
Instructions
Get the calibration report — Brier score, accuracy, and confidence-vs-outcome breakdown. Lower Brier score = better calibrated.
Perfect calibration: Brier = 0.0 Random guessing: Brier = 0.25 Always wrong at 100%: Brier = 1.0
Args: domain: Filter by domain (empty = all domains) days: Look back period in days
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| days | No | ||
| domain | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |