Skip to main content
Glama
rebaselabs-framework

llm-router-mcp

Official
by rebaselabs-framework
OverviewSchemaRelated ServersScoreDiscussions
Python
Remote

llm-router-mcp

MCP server for the LLM Router API — route AI chat requests to the best available provider (Anthropic Claude, OpenAI GPT, Groq, Mistral, Together AI) with automatic fallback, budget caps, and model-tier routing.

Why use LLM Router?

  • One API key instead of managing Anthropic + OpenAI + Groq + Mistral keys separately

  • Automatic fallback — if your primary provider is down, the next one kicks in

  • Model tiers — say "fast" or "smart" instead of hard-coding a model name

  • Budget caps — set max_cost_usd so agents never overspend

  • Fallback chains — control exactly which providers to try and in what order

Installation

pip install llm-router-mcp
# or
uvx llm-router-mcp

Configuration

Add to your Claude Desktop / agent MCP config:

{
  "mcpServers": {
    "llm-router": {
      "command": "uvx",
      "args": ["llm-router-mcp"],
      "env": {
        "LLM_ROUTER_API_KEY": "your-api-key-here"
      }
    }
  }
}

Get an API key at llm-router-api.rebaselabs.online.

Tools

Tool

Description

chat

Route a chat request to the best provider

chat_with_system

Simplified chat with system prompt + user message

estimate_cost

Estimate cost across providers before sending

list_providers

List providers and their availability

get_models

Full model catalog with pricing

get_usage

Your API usage statistics

Examples

Simple chat

{
  "tool": "chat",
  "messages": [{"role": "user", "content": "Summarize this document: ..."}],
  "model": "fast",
  "max_cost_usd": 0.002
}

System prompt + task

{
  "tool": "chat_with_system",
  "system_prompt": "You are a JSON extractor. Return only valid JSON arrays.",
  "user_message": "Extract all emails from: Contact john@acme.com or help@corp.io"
}

Explicit fallback chain

{
  "tool": "chat",
  "messages": [{"role": "user", "content": "Write a Python quicksort"}],
  "model": "code",
  "fallback_chain": ["together", "anthropic", "openai"]
}

Model Tiers

Tier

Description

Best for

fast

Lowest latency (Groq, Mistral)

Real-time tasks, high throughput

smart

Highest quality (Claude, GPT-4)

Complex reasoning, writing

code

Coding-optimized (Deepseek, Claude)

Code generation, review

cheap

Lowest cost per token

High-volume, simple tasks

large

Maximum context window

Long documents, many-shot prompts

Environment Variables

Variable

Default

Description

LLM_ROUTER_API_KEY

(required)

Your API key

LLM_ROUTER_API_URL

https://llm-router-api.rebaselabs.online

API base URL (for self-hosting)

This server cannot be installed

-
license - not tested
-
quality - not tested
D
maintenance

How are these scores calculated?

Maintenance

–Maintainers
–Response time
–Release cycle
–Releases (12mo)
Commit activity

Resources

Unclaimed servers have limited discoverability.

Looking for Admin?

If you are the server author, to access and configure the admin panel.

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/rebaselabs-framework/llm-router-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server