benchmark_run
Record a measured benchmark run using a raw artifact reference. The 'baseline' arm defines the performance threshold for challengers to beat.
Instructions
Record a tool-measured run of an arm through the frozen benchmark. arm:"baseline" sets the bar challengers must beat. Requires a measurementRef → a recorded raw artifact; model self-report never sets the bar.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"runId": "<runId>",
"arm": "<arm>",
"measurementRef": "<measurementRef>"
},
"name": "benchmark_run"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| arm | Yes | "baseline" or a hypothesis id | |
| runId | Yes | ||
| measurementRef | Yes |