llm_benchmark
See how accurately the LLM router selects models for different task types. Your thumbs up/down ratings help refine these accuracy scores.
Instructions
Show routing accuracy benchmarks by task type.
Accuracy is computed from llm_rate feedback (thumbs up/down). The more you rate responses with llm_rate, the more accurate this becomes.
Also shows an optional community export status if LLM_ROUTER_COMMUNITY=true.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "llm_benchmark"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |