get criterion alignment
get_criterion_alignmentFetch the persistent alignment report from a criterion's last calibration run, including metrics, threshold sweep, and judge-human disagreements, to review calibration quality without re-judging.
Instructions
Read the persistent report from the criterion's last calibration run: metrics with intervals, population breakdown, threshold sweep, and every judge/human disagreement with the human's critique and a response excerpt. Free; it never re-judges. GET /v1/criteria/{id}/alignment (API-key scope: read). Returns: { aligned_at, scope_tag, tag_breakdown: [{ tag, n }], mixed_population, tier, thin_alignment_set, metrics: { n, tpr, tpr_ci, tnr, tnr_ci, kappa }, threshold_analysis: { half ("tune"|"all"), sweep: { n, ungraded, argmax: metrics, best: { threshold, metrics, youden_j }|null, curve: [{ threshold, metrics, youden_j }], note }, report_check: { threshold, n, metrics, youden_j, argmax }|null }|null, agreements (count), disagreements: [{ request_id, judge_verdict, human_verdict, critique, tag, response_excerpt }] } Notes: 404 "Criterion not found". 400 "This criterion has no alignment run yet" when never calibrated or after a voiding edit; 400 "Alignment run in progress — N labels judged so far" while a background run is in flight (use it to poll). threshold_analysis is null for runs recorded before logprob grades were stored. All nested keys are snake_case.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| id | Yes | Criterion id. |