Run a saved model on the sealed test set and score it
evaluateRuns a saved model on test features and scores its predictions against sealed labels, using one reveal; the model executes isolated with no network or label access.
Instructions
Run a saved model on the test features, then score its predictions on the sealed labels.
model_path is a joblib/pickle estimator, or a folder with predict.py defining predict(features) -> predictions. In sealed mode the model runs in an isolated container with no network and no access to labels. Spends one reveal when it succeeds.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"dataset": "<dataset>",
"model_path": "<model_path>"
},
"name": "evaluate"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| seed | No | ||
| dataset | Yes | ||
| model_path | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | Yes | ||
| stamp | No | Provenance: commit, dirty flag, data/scorer/lockfile hashes, seed, ledger entry | |
| budget | No | ||
| status | Yes | 'scored' means metrics were revealed and one reveal was spent | |
| dataset | Yes | ||
| message | Yes | Plain-English summary of what happened | |
| metrics | No | ||
| findings | No | ||
| n_scored | No | ||
| remaining | No | Reveals left after this call |