benchmark_propose
Propose benchmark scorecards built from real prior uses and failures, requiring task-value and resource dimensions with concrete cases to ensure validity.
Instructions
Propose one or more benchmark scorecards built from real prior uses/failures. Each needs ≥1 task-value dimension, ≥1 resource/cost dimension, and ≥1 concrete case, or it is rejected as a hand-waved benchmark.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"runId": "<runId>",
"benchmarks": "<benchmarks>"
},
"name": "benchmark_propose"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| runId | Yes | ||
| benchmarks | Yes |