Score predictions against the sealed test labels
scoreScores a CSV or Parquet predictions file against a dataset’s sealed test set and returns aggregate metrics only, without exposing labels or per-row results.
Instructions
Score a predictions file (CSV or Parquet) on the sealed test set.
The file needs the dataset's id column and a 'prediction' column. Returns aggregate metrics only, never labels or per-row results. Spends one reveal when it succeeds.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"dataset": "<dataset>",
"predictions_path": "<predictions_path>"
},
"name": "score"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| seed | No | ||
| dataset | Yes | ||
| predictions_path | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | Yes | ||
| stamp | No | Provenance: commit, dirty flag, data/scorer/lockfile hashes, seed, ledger entry | |
| budget | No | ||
| status | Yes | 'scored' means metrics were revealed and one reveal was spent | |
| dataset | Yes | ||
| message | Yes | Plain-English summary of what happened | |
| metrics | No | ||
| findings | No | ||
| n_scored | No | ||
| remaining | No | Reveals left after this call |