llm_benchmark
Show routing accuracy benchmarks by task type. Accuracy is computed from user feedback (thumbs up/down) and improves with more ratings.
Instructions
Show routing accuracy benchmarks by task type.
Accuracy is computed from llm_rate feedback (thumbs up/down). The more you rate responses with llm_rate, the more accurate this becomes.
Also shows an optional community export status if LLM_ROUTER_COMMUNITY=true.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |