list criteria
list_criteriaList judge criteria with calibration metrics, trust verdicts, and drift status to identify which judges are reliable enough for gating.
Instructions
List this workspace's judge criteria with their calibration metrics (TPR/TNR/kappa with intervals), trust verdict, drift status and online-monitoring config, to see which judges are proven enough to gate on. GET /v1/criteria (API-key scope: read). Returns: { object: "list", data: [{ id, name, description, judge_prompt, judge_model, status, source, unit ("request"|"trace"), population (tag), population_family, online_enabled, online_percent, online_cap_usd, online_spent_usd, tier (aligned|weak|misaligned|unmeasured), trust (trustworthy|misaligned|under-measured|borderline|unmeasured), fail_grades_needed, pass_grades_needed, tpr_ci ([lo,hi]|null), tnr_ci, drift_status (ok|flagged), drift_signal (stale|quality_drop|suspicious_rise|evidence_revised|null), drift_reason, drift_checked_at, tpr, tnr, kappa, alignment_n, aligned_at, created_at }] } Notes: trust is what every gate reads; tier is the legacy point-estimate badge. drift_status is derived (a fresh calibration supersedes a cached flag). drift_signal names the check that raised it: stale (calibration older than 30 days), quality_drop (live corrected rate fell well below what the judge validated at), suspicious_rise (traffic from a model TRAINED AGAINST this judge scores above what it validated at — an unvalidated gain), evidence_revised (grades the calibration was measured on were edited or deleted; clears on re-calibration or on reverting the edits).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||