BenchGecko
Server Details
AI model prices per provider, benchmarks, own AI behavior tests and AI economy data, with sources.
- Status
- Healthy
- Uptime
- 100.0% over the last 24 hours
- Last Tested
- Transport
- Streamable HTTP · MCP 2025-11-25
- URL
- Repository
- BenchGecko/datasets
- GitHub Stars
- 0
- ChatGPT
- –
- Claude
- –
TDQS
Scored across 9 tools
Both search and search_models can be used to find models, and fetch overlaps with get_model/get_gecko_test/get_scorecard by retrieving similar records. Descriptions clarify intended use (ids vs slugs, full record vs core facts), but an agent could still misselect.
Names are consistently snake_case and mostly follow verb_noun, but fetch and search are bare verbs, and cheapest_provider/latest_findings are noun phrases. Still readable and predictable overall.
9 tools is well-scoped for a model benchmark and pricing catalog. Each tool has a plausible role, and the set is neither thin nor bloated.
Covers search, model details, provider pricing, comparisons, Gecko test results, scorecard, and latest findings. Minor gap: no explicit list-all-models or filter-by-price/provider query, but core read-only workflows are covered.
Available Tools
9 toolscheapest_providerCheapest provider for a modelARead-onlyIdempotentInspect
Every provider serving a model, sorted by input price per 1M tokens (refreshed daily from provider endpoints), with output price, quantization and 1 day uptime.
Inputs: model (required).
compare_modelsCompare two modelsARead-onlyIdempotentInspect
Side by side: BenchGecko score, list price, cheapest provider, context window, shared benchmark scores and Gecko Tests grades for two models.
Inputs: a (required), b (required).
fetchFetch a BenchGecko recordARead-onlyIdempotentInspect
Fetch the full record for an id returned by search (model:, gecko-test: or scorecard).
Inputs: id (required).
get_gecko_testGecko Test resultsARead-onlyIdempotentInspect
Results of one of BenchGecko's own tests (own measurements, CC BY 4.0): who-are-you (Does the model know which lab made it?) world-map (How well does the model draw the world map from memory?) censorship-index (How often does the model refuse legitimate questions?) knowledge-horizon (Where does the model's knowledge of world events actually stop?) tokenizer-tax (How many more tokens does the same text cost outside English?) same-model-different-host (Do providers serving the same open model give the same quality?) model-drift-index (Do models quietly change behind the same name?)
Inputs: test (required), limit.
get_modelGet model factsARead-onlyIdempotentInspect
Core facts for one AI model: BenchGecko score and rank, list price, price at every provider, benchmark scores with their original sources, Gecko Tests grades and as-of dates.
Inputs: model (required).
get_scorecardGecko ScorecardBRead-onlyIdempotentInspect
BenchGecko Gecko Scorecard: every model across BenchGecko's own profile tests with a letter grade per test and an overall Gecko Score (behavior, not intelligence).
Inputs: limit.
latest_findingsLatest findingsCRead-onlyIdempotentInspect
Latest notable results detected in the Gecko Tests and price data (fixed rules, numbers and quotes from stored results).
Inputs: limit.
searchSearch BenchGeckoBRead-onlyIdempotentInspect
Search BenchGecko models and Gecko Tests. Returns ids for fetch.
Inputs: query (required).
search_modelsSearch AI modelsARead-onlyIdempotentInspect
Find AI models in the BenchGecko catalog by name, slug or lab. Returns slugs to use with get_model, cheapest_provider and compare_models, with BenchGecko score and list price.
Inputs: query (required), limit.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Related MCP Connectors
Source-backed AI model pricing, rankings, history, and benchmark data.
Verified, dated prices for 293 AI APIs in 45 markets: LLMs, GPUs, speech, video and more.
Live prices, rankings, licences and privacy of AI models: best model per task, costs, alternatives.
AI model prices, providers, EU hosting and benchmarks: find, compare, save and watch offers.
Related MCP Servers
AlicenseNot gradedqualityBmaintenanceLive, sourced pricing and benchmark data across image, language, video, and audio AI models, seven tools for comparison, competitor lookups, and cost-aware routing. Also powers the free Modelglass VS Code extension.1MIT- AlicenseAqualityBmaintenanceGlobal price benchmarking for AI inference across 2,600+ SKUs from 47 vendors. Query live pricing, market indexes, and model specs via 8 tools. Free tier available.859 npmMIT
- AlicenseAqualityBmaintenanceLive LLM API pricing: current token prices, model comparisons, cheapest-model lookups, and The LLM Price Index for 150+ models across 20+ providers, re-verified daily. No API key required.41MIT
- AlicenseNot gradedqualityCmaintenanceMachine-readable AI market data for AI agents: subscription prices, free credits, free LLM models, China-exclusive AI pricing. 6 MCP tools, Streamable HTTP, no auth.MIT
Glama MCP Gateway
Add one secure layer between your agents and this server.