freeze label set
freeze_label_setFreeze a golden set to seal its membership with a hash and compute inter-rater agreement (kappa), a required step before judges can calibrate on the set.
Instructions
Freeze a golden set: seal its membership with a hash and measure inter-rater agreement (kappa) on its members — required before a judge can calibrate on it. POST /v1/label_sets/{id}/freeze (API-key scope: evals:write). Returns: 200 with the updated set object: { id, name, description, size, membership_hash (sha256 of sorted member ids), frozen_at (ISO), kappa: number|null, agreement: number|null, kappa_n: integer|null, rater_count: integer, attached_to: [ { id, name } ], created_at }. Notes: No body. Re-freezing an already-frozen set re-measures kappa/agreement/rater_count but keeps the original frozen_at and membership. kappa is null (and reported as null, never as good) when fewer than two raters' blind re-grades exist inside the set. 400 if inter-rater stats are unavailable.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| id | Yes | The golden set id (workspace-scoped; 404 'Golden set not found' otherwise). |