benchmark_freeze_maker
Freeze a benchmark directly from the maker source, bypassing worker proposal. Defaults to gate (held-out) partition for held-out evaluation.
Instructions
Bench-maker only: freeze a benchmark directly (benchSource:maker) without worker benchmark_propose. Defaults benchPartition to gate (held-out). Worker benchmark_propose becomes a no-op while this scorecard is frozen.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"runId": "<runId>",
"benchmark": "<benchmark>"
},
"name": "benchmark_freeze_maker"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| runId | Yes | ||
| newEpoch | No | ||
| benchmark | Yes | Full scorecard: name, taskValueDimensions, resourceDimensions, cases, oracle, etc. | |
| rationale | No | ||
| benchPartition | No | gate (held-out, default) or harvest |