Calibration report
calibration_reportCompare decision confidence against human consensus on stored evaluations by rubric to reveal calibration gaps and align automated scoring with reviewer judgment.
Instructions
Compare decision confidence against human consensus on stored evaluations.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"rubricId": "<rubricId>"
},
"name": "calibration_report"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | No | ||
| buckets | No | ||
| rubricId | Yes |