Skip to main content
Glama

Multi LLM Cross-Check MCP Server

Multi LLM Cross-Check MCP Server

A Model Control Protocol (MCP) server that allows cross-checking responses from multiple LLM providers simultaneously. This server integrates with Claude Desktop as an MCP server to provide a unified interface for querying different LLM APIs.

Features

  • Query multiple LLM providers in parallel
  • Currently supports:
    • OpenAI (ChatGPT)
    • Anthropic (Claude)
    • Perplexity AI
    • Google (Gemini)
  • Asynchronous parallel processing for faster responses
  • Easy integration with Claude Desktop

Prerequisites

  • Python 3.8 or higher
  • API keys for the LLM providers you want to use
  • uv package manager (install with pip install uv)

Installation

Installing via Smithery

To install Multi LLM Cross-Check Server for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @lior-ps/multi-llm-cross-check-mcp-server --client claude

Manual Installation

  1. Clone this repository:
git clone https://github.com/lior-ps/multi-llm-cross-check-mcp-server.git cd multi-llm-cross-check-mcp-server
  1. Initialize uv environment and install requirements:
uv venv uv pip install -r requirements.txt
  1. Configure in Claude Desktop: Create a file named claude_desktop_config.json in your Claude Desktop configuration directory with the following content:
    { "mcp_servers": [ { "command": "uv", "args": [ "--directory", "/multi-llm-cross-check-mcp-server", "run", "main.py" ], "env": { "OPENAI_API_KEY": "your_openai_key", // Get from https://platform.openai.com/api-keys "ANTHROPIC_API_KEY": "your_anthropic_key", // Get from https://console.anthropic.com/account/keys "PERPLEXITY_API_KEY": "your_perplexity_key", // Get from https://www.perplexity.ai/settings/api "GEMINI_API_KEY": "your_gemini_key" // Get from https://makersuite.google.com/app/apikey } } ] }
    Notes:
    1. You only need to add the API keys for the LLM providers you want to use. The server will skip any providers without configured API keys.
    2. You may need to put the full path to the uv executable in the command field. You can get this by running which uv on MacOS/Linux or where uv on Windows.

Using the MCP Server

Once configured:

  1. The server will automatically start when you open Claude Desktop
  2. You can use the cross_check tool in your conversations by asking to "cross check with other LLMs"
  3. Provide a prompt, and it will return responses from all configured LLM providers

API Response Format

The server returns a dictionary with responses from each LLM provider:

{ "ChatGPT": { ... }, "Claude": { ... }, "Perplexity": { ... }, "Gemini": { ... } }

Error Handling

  • If an API key is not provided for a specific LLM, that provider will be skipped
  • API errors are caught and returned in the response
  • Each LLM's response is independent, so errors with one provider won't affect others

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License - see the LICENSE file for details.

-
security - not tested
A
license - permissive license
-
quality - not tested

remote-capable server

The server can be hosted and run remotely because it primarily relies on remote services or has no dependency on the local environment.

A Model Control Protocol server that integrates with Claude Desktop to enable simultaneous querying and cross-checking of responses from multiple LLM providers including OpenAI, Anthropic, Perplexity AI, and Google Gemini.

  1. Features
    1. Prerequisites
      1. Installation
        1. Installing via Smithery
        2. Manual Installation
      2. Using the MCP Server
        1. API Response Format
          1. Error Handling
            1. Contributing
              1. License

                Related MCP Servers

                • -
                  security
                  A
                  license
                  -
                  quality
                  Model Context Protocol (MCP) server implementation that enables Claude Desktop to interact with Google's Gemini AI models.
                  Last updated -
                  182
                  JavaScript
                  MIT License
                  • Apple
                  • Linux
                • -
                  security
                  F
                  license
                  -
                  quality
                  A Model Control Protocol server that provides web search capabilities and similarity search functionality for Claude Desktop, allowing users to perform web searches and extract relevant information from previous search results.
                  Last updated -
                  2
                  Python
                  • Apple
                  • Linux
                • -
                  security
                  A
                  license
                  -
                  quality
                  A Model Context Protocol server that enables Claude to collaborate with Google's Gemini AI models, providing tools for question answering, code review, brainstorming, test generation, and explanations.
                  Last updated -
                  Python
                  MIT License
                • -
                  security
                  F
                  license
                  -
                  quality
                  A Model Context Protocol server that gives Claude access to multiple AI models (Gemini, OpenAI, OpenRouter) for enhanced code analysis, problem-solving, and collaborative development through AI orchestration with conversations that continue across tasks.
                  Last updated -
                  5,128
                  Python
                  • Apple

                View all related MCP servers

                MCP directory API

                We provide all the information about MCP servers via our MCP API.

                curl -X GET 'https://glama.ai/api/mcp/v1/servers/lior-ps/multi-llm-cross-check-mcp-server'

                If you have feedback or need assistance with the MCP directory API, please join our Discord server