get_report
Generate a Markdown report for a benchmark run, covering per-language confidently-wrong rates, accuracy, confidence gaps, hedge-word checks, and example answers.
Instructions
Markdown report: confidently-wrong rate per language, accuracy, confidence when right vs wrong, hedge-word cross-check, language gaps, per-question grid and example answers.
Args: run_id: the run to report on. examples: how many confidently-wrong answers to quote. per_question: include the per-question grid.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"run_id": "<run_id>"
},
"name": "get_report"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| run_id | Yes | ||
| examples | No | ||
| per_question | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |