save_evals
Validate and persist retrieval eval cases, rejecting unverifiable kbids and duplicates to keep only accurate, search-confirmed examples.
Instructions
Validate and persist retrieval eval cases drafted via the eval-generate prompt. Rejects cases whose kbids do not resolve, and drops duplicates. Call it only with kbids a search actually returned; invented ids fail the whole batch.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"cases": "<cases>"
},
"name": "save_evals"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| cases | Yes | JSONL, one case per line: {"query","expectedKbids",["grades"]} |