MCP DeepInfra AI Tools Server

This is a Model Context Protocol (MCP) server that provides various AI capabilities using the DeepInfra OpenAI-compatible API, including image generation, text processing, embeddings, speech recognition, and more.

Project Structure

Setup

1. Install uv if not already installed:

   curl -LsSf https://astral.sh/uv/install.sh | sh

2. Clone or download this repository.

3. Install dependencies:

   uv sync

4. Set up your DeepInfra API key: Create a .env file in the project root:

   DEEPINFRA_API_KEY=your_api_key_here

Configuration

You can configure which tools are enabled and set default models for each tool using environment variables in your .env file:

• ENABLED_TOOLS: Comma-separated list of tools to enable. Use "all" to enable all tools (default: "all"). Example: ENABLED_TOOLS=generate_image,text_generation,embeddings

• MODEL_GENERATE_IMAGE: Default model for image generation (default: "Bria/Bria-3.2")

• MODEL_TEXT_GENERATION: Default model for text generation (default: "meta-llama/Llama-2-7b-chat-hf")

• MODEL_EMBEDDINGS: Default model for embeddings (default: "sentence-transformers/all-MiniLM-L6-v2")

• MODEL_SPEECH_RECOGNITION: Default model for speech recognition (default: "openai/whisper-large-v3")

• MODEL_ZERO_SHOT_IMAGE_CLASSIFICATION: Default model for zero-shot image classification (default: "openai/gpt-4o-mini")

• MODEL_OBJECT_DETECTION: Default model for object detection (default: "openai/gpt-4o-mini")

• MODEL_IMAGE_CLASSIFICATION: Default model for image classification (default: "openai/gpt-4o-mini")

• MODEL_TEXT_CLASSIFICATION: Default model for text classification (default: "microsoft/DialoGPT-medium")

• MODEL_TOKEN_CLASSIFICATION: Default model for token classification (default: "microsoft/DialoGPT-medium")

• MODEL_FILL_MASK: Default model for fill mask (default: "microsoft/DialoGPT-medium")

If a model is not specified when calling a tool, the default model will be used. You can still override the model for each tool call.

Running the Server

To run the server locally:

Or directly with Python:

Using with MCP Clients

Configure your MCP client (e.g., Claude Desktop) to use this server.

For Claude Desktop, add to your claude_desktop_config.json:

Tools Provided

This server provides the following MCP tools:

• generate_image: Generate an image from a text prompt using specified model. Returns the URL of the generated image.

• text_generation: Generate text completion from a prompt using specified model.

• embeddings: Generate embeddings for a list of input texts using specified model.

• speech_recognition: Transcribe audio from a URL to text using Whisper model.

• zero_shot_image_classification: Classify an image into provided candidate labels using vision model.

• object_detection: Detect and describe objects in an image using multimodal model.

• image_classification: Classify and describe contents of an image using multimodal model.

• text_classification: Analyze text for sentiment and category using specified model.

• token_classification: Perform named entity recognition (NER) on text using specified model.

• fill_mask: Fill masked tokens in text with appropriate words using specified model.

Testing

To test the server locally, run the pytest test suite:

The tests include:

• Server initialization and tool listing

• Individual tool functionality tests via JSON-RPC protocol

• All tests run synchronously without async/await complexity

Running with uvx

uvx is designed for running published Python packages from PyPI or GitHub. For local development, use the uv run command as described above.

If you publish this package to PyPI (e.g., as mcp-deepinfra), you can run it with:

And configure your MCP client to use:

For local development, stick with the uv run approach.