llm-router-mcp

MCP server for the LLM Router API — route AI chat requests to the best available provider (Anthropic Claude, OpenAI GPT, Groq, Mistral, Together AI) with automatic fallback, budget caps, and model-tier routing.

Why use LLM Router?

• One API key instead of managing Anthropic + OpenAI + Groq + Mistral keys separately

• Automatic fallback — if your primary provider is down, the next one kicks in

• Model tiers — say "fast" or "smart" instead of hard-coding a model name

• Budget caps — set max_cost_usd so agents never overspend

• Fallback chains — control exactly which providers to try and in what order

Related MCP server: Multi-LLM Gateway MCP

Installation

pip install llm-router-mcp
# or
uvx llm-router-mcp

Configuration

Add to your Claude Desktop / agent MCP config:

{
  "mcpServers": {
    "llm-router": {
      "command": "uvx",
      "args": ["llm-router-mcp"],
      "env": {
        "LLM_ROUTER_API_KEY": "your-api-key-here"
      }
    }
  }
}

Get an API key at llm-router-api.rebaselabs.online.

Tools

Examples

Simple chat

{
  "tool": "chat",
  "messages": [{"role": "user", "content": "Summarize this document: ..."}],
  "model": "fast",
  "max_cost_usd": 0.002
}

System prompt + task

{
  "tool": "chat_with_system",
  "system_prompt": "You are a JSON extractor. Return only valid JSON arrays.",
  "user_message": "Extract all emails from: Contact john@acme.com or help@corp.io"
}

Explicit fallback chain

{
  "tool": "chat",
  "messages": [{"role": "user", "content": "Write a Python quicksort"}],
  "model": "code",
  "fallback_chain": ["together", "anthropic", "openai"]
}

Model Tiers

Environment Variables