LLMBenchmark.ai MCP server
OfficialThis server has a remotely hosted endpoint. Open its connector listing for connection details, authentication requirements, and setup instructions:
LLMBenchmark.ai MCP server
Ask "which model should I use for this task?" and get an answer from benchmark scores and API prices of 400+ LLMs, updated daily.
Free. No API key. 500 requests per IP per UTC day.
Remote server, Streamable HTTP:
https://api.llmbenchmark.ai/mcpDeterministic: no LLM call inside, the same task and the same data return the same answer.
Every answer carries the data date, the source ("LLMBenchmark.ai") and links to the pages behind the numbers.
Docs: https://llmbenchmark.ai/api
Install
Claude Code
claude mcp add --transport http llmbenchmark https://api.llmbenchmark.ai/mcpCursor (.cursor/mcp.json)
{
"mcpServers": {
"llmbenchmark": { "url": "https://api.llmbenchmark.ai/mcp" }
}
}Codex (~/.codex/config.toml)
[mcp_servers.llmbenchmark]
url = "https://api.llmbenchmark.ai/mcp"Claude Desktop (claude_desktop_config.json, through the mcp-remote bridge)
{
"mcpServers": {
"llmbenchmark": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://api.llmbenchmark.ai/mcp"]
}
}
}Install as a local server (stdio)
The package proxies to the hosted server, so clients that only start local commands can use it too. Needs uv.
uvx llmbenchmark-mcpClaude Desktop (claude_desktop_config.json):
{
"mcpServers": {
"llmbenchmark": {
"command": "uvx",
"args": ["llmbenchmark-mcp"]
}
}
}Docker, built from this repository:
docker build -t llmbenchmark-mcp . && docker run -i --rm llmbenchmark-mcpSet LLMBENCHMARK_MCP_URL to point the proxy at another endpoint.
Related MCP server: ai-compass
Tools
Tool | What it does |
| Task text plus optional limits ( |
| Top models on one board: overall, coding, agentic, reasoning, math, knowledge, design. |
| Two models side by side on every board where both were measured. |
| One model: maker, prices, context, open weights, score and rank per board. |
| API list prices per million tokens, cheapest first, by model or maker. |
| The categories, the board behind each and the task keywords that select it. |
recommend_model maps the task to a category with a fixed keyword map (printed at https://llmbenchmark.ai/api#how-recommend-works), drops models that break your limits and ranks the rest on that category's board. If nothing fits your limits it says so and returns the nearest options.
Example prompts
"Which model should I use to refactor a React app under $5 per million output tokens?"
"What is the best open-weight model for math with at least a 128k context window?"
"Compare Claude Opus and GPT-6 Astra for coding."
"Which models are cheapest on output price from DeepSeek?"
CLI
llmbenchmark-mcp recommend "refactor a React app" --max-price 5 --open-weights
llmbenchmark-mcp tools
llmbenchmark-mcp configrecommend prints the recommend_model answer, tools lists the tool names, config prints the remote JSON config for Claude or Cursor. With no arguments the command runs the stdio server.
REST
The same answers over plain HTTP:
curl "https://api.llmbenchmark.ai/v1/recommend?task=refactor+a+large+React+codebase&max_output_price_per_m=5"License
This README and the configuration files in this repository: MIT, see
LICENSE.The data the server returns: CC BY 4.0. Credit "LLMBenchmark.ai" with a link to https://llmbenchmark.ai. Each score names its source board and the day it was read; the boards keep their own terms.
Run by Take Group.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
Compare LLM API prices, search models and providers, and access reviewed benchmark results.
Benchmark your own prompt on 100+ LLMs with real API calls; pick the cheapest model that passes.
Daily LLM leaderboard from independent benchmarks: ranks, scores, prices, speed and comparisons.
Live LLM API pricing: token prices, comparisons, cheapest-model lookups. No key required.
Related MCP Servers
- AlicenseAqualityDmaintenanceProvides access to real-time LLM pricing, speed metrics, and performance benchmarks for over 300 models from Artificial Analysis. It enables users to list, filter, and compare models based on costs, tokens per second, and intelligence indices.239 npm9MIT
- AlicenseDqualityDmaintenanceDescribe your AI use case in plain English, get ranked model recommendations with cost estimates and tradeoff reasoning. Covers 62 models across 29 providers. Available as a web app (BYOK + guest tier) and as an MCP server for Claude Desktop and Cursor — same recommendation engine, two interfaces.11MIT
- AlicenseNot gradedqualityDmaintenanceEnables AI agents to compare LLM benchmarks, get pricing, and receive model recommendations for tasks and budgets.1MIT
- AlicenseAqualityBmaintenanceLive LLM API pricing: current token prices, model comparisons, cheapest-model lookups, and The LLM Price Index for 150+ models across 20+ providers, re-verified daily. No API key required.41MIT