Get benchmark scenario
get_benchmark_scenarioRead one benchmark scenario with per-model quality, cost and speed results. include_reference=true adds the reference, the fixed entity_data and the schema-generation entity_samples. Config changes can make existing results stale. No LLM call. For a ranked subset use get_benchmark_scenario_results. Read after run_benchmark completes.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"scenario_id": "<scenario_id>"
},
"name": "get_benchmark_scenario"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| scenario_id | Yes | UUID of the scenario. | |
| include_reference | No | Include reference_output + entity_data (can be large). |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||