multimodal-mcp
Provides text-to-speech, sound effects, and audio transcription capabilities using ElevenLabs API (Flash v2.5, Scribe v1).
Supports image generation and editing via imagen-4, video generation via veo-3.1, and audio generation via gemini-2.5-flash-preview-tts using Google's Gemini API.
Enables image generation and editing via gpt-image-1, video generation via sora-2, audio generation via tts-1, and audio transcription via whisper-1.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@multimodal-mcp Generate an image of a serene mountain lake at sunrise."
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
multimodal-mcp
Multi-provider media generation MCP server. Generate images, videos, audio, and transcriptions from text prompts using OpenAI, xAI, Gemini, ElevenLabs, and BFL (FLUX) through a single unified interface.
Features
🎨 Image Generation — Generate images via OpenAI (gpt-image-1), xAI (grok-imagine-image), Gemini (imagen-4), or BFL (FLUX Pro 1.1)
✏️ Image Editing — Edit images via OpenAI, xAI, Gemini, or BFL (FLUX Kontext)
🎬 Video Generation — Generate videos via OpenAI (sora-2), xAI (grok-imagine-video), or Gemini (veo-3.1)
🔊 Audio Generation — Text-to-speech via OpenAI (tts-1), Gemini, or ElevenLabs (Flash v2.5). Sound effects via ElevenLabs
🎙️ Audio Transcription — Speech-to-text via OpenAI (Whisper) or ElevenLabs (Scribe)
🔄 Auto-Discovery — Automatically detects configured providers from environment variables
🎯 Provider Selection — Auto-selects or explicitly choose a provider per request
📁 File Output — Saves all generated media to disk with descriptive filenames
Related MCP server: universal-image-mcp
Quick Start
Set the API key for at least one provider. Most users only need one — add more to access additional providers.
# Using OpenAI
claude mcp add multimodal-mcp -e OPENAI_API_KEY=sk-... -- npx -y @r16t/multimodal-mcp@latest
# Or using xAI
# claude mcp add multimodal-mcp -e XAI_API_KEY=xai-... -- npx -y @r16t/multimodal-mcp@latest
# Or using Gemini
# claude mcp add multimodal-mcp -e GEMINI_API_KEY=AIza... -- npx -y @r16t/multimodal-mcp@latest
# Or using ElevenLabs (audio + transcription)
# claude mcp add multimodal-mcp -e ELEVENLABS_API_KEY=xi-... -- npx -y @r16t/multimodal-mcp@latest
# Or using BFL/FLUX (images)
# claude mcp add multimodal-mcp -e BFL_API_KEY=... -- npx -y @r16t/multimodal-mcp@latestUsing a different editor? See setup instructions for Claude Desktop, Cursor, VS Code, Windsurf, and Cline.
Environment Variables
Variable | Required | Description |
| At least one provider key | OpenAI API key — enables image, video, audio generation, and transcription via gpt-image-1, sora-2, tts-1, and whisper-1 |
| At least one provider key | xAI API key — enables image and video generation via grok-imagine-image and grok-imagine-video |
| At least one provider key | Gemini API key — enables image, video, and audio generation via imagen-4, veo-3.1, and gemini-2.5-flash-preview-tts |
| — | Alias for |
| At least one provider key | ElevenLabs API key — enables audio generation (TTS, sound effects) and transcription via Flash v2.5 and Scribe v1 |
| At least one provider key | BFL API key — enables image generation and editing via FLUX Pro 1.1 and FLUX Kontext |
| No | Directory for saved media files. Defaults to the current working directory |
Available Tools
generate_image
Generate an image from a text prompt.
Parameter | Type | Required | Description |
| string | Yes | Text description of the image to generate |
| string | No | Provider to use: |
| string | No | Aspect ratio: |
| string | No | Quality level: |
| string | No | Directory to save the generated file. Absolute or relative path. Defaults to |
| object | No | Provider-specific parameters passed through directly |
generate_video
Generate a video from a text prompt. Video generation is asynchronous and may take several minutes.
Parameter | Type | Required | Description |
| string | Yes | Text description of the video to generate |
| string | No | Provider to use: |
| number | No | Video duration in seconds (provider limits apply) |
| string | No | Aspect ratio: |
| string | No | Resolution: |
| string | No | Directory to save the generated file. Absolute or relative path. Defaults to |
| object | No | Provider-specific parameters passed through directly |
generate_audio
Generate audio from text. Supports text-to-speech and sound effects. Audio generation is synchronous.
Parameter | Type | Required | Description |
| string | Yes | Text to convert to speech, or a description of the sound effect to generate |
| string | No | Provider to use: |
| string | No | Voice name (provider-specific). OpenAI: |
| number | No | Speech speed multiplier (OpenAI only): |
| string | No | Output format (OpenAI only): |
| string | No | Directory to save the generated file. Absolute or relative path. Defaults to |
| object | No | Provider-specific parameters passed through directly. ElevenLabs: set |
transcribe_audio
Transcribe audio to text (speech-to-text).
Parameter | Type | Required | Description |
| string | Yes | Absolute path to the audio file to transcribe |
| string | No | Provider to use: |
| string | No | Language code (e.g., |
| object | No | Provider-specific parameters passed through directly |
list_providers
List all configured media generation providers and their capabilities. Takes no parameters.
Provider Capabilities
Provider | Image | Image Editing | Video | Audio | Transcription | Key Models |
OpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | gpt-image-1, sora-2, tts-1, whisper-1 |
xAI | ✅ | ✅ | ✅ | — | — | grok-imagine-image, grok-imagine-video |
Gemini | ✅ | ✅ | ✅ | ✅ | — | imagen-4, veo-3.1, gemini-2.5-flash-preview-tts |
ElevenLabs | — | — | — | ✅ | ✅ | eleven_flash_v2_5, scribe_v1 |
BFL | ✅ | ✅ | — | — | — | flux-pro-1.1, flux-kontext-pro |
Image Aspect Ratios
Provider | 1:1 | 16:9 | 9:16 | 4:3 | 3:4 |
OpenAI | ✅ | ✅ | ✅ | ✅ | ✅ |
xAI | ✅ | ✅ | ✅ | ✅ | ✅ |
Gemini | ✅ | ✅ | ✅ | ✅ | ✅ |
BFL | ✅ | ✅ | ✅ | ✅ | ✅ |
Video Aspect Ratios & Resolutions
Provider | 16:9 | 9:16 | 1:1 | 480p | 720p | 1080p |
OpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
xAI | ✅ | ✅ | ✅ | — | ✅ | ✅ |
Gemini | ✅ | ✅ | — | — | ✅ | ✅ |
Audio Formats
Provider | mp3 | opus | aac | flac | wav | pcm |
OpenAI | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
Gemini | — | — | — | — | ✅ | — |
ElevenLabs | ✅ | ✅ | — | — | — | ✅ |
Troubleshooting
No providers configured
[config] No provider API keys detectedSet at least one of OPENAI_API_KEY, XAI_API_KEY, GEMINI_API_KEY, ELEVENLABS_API_KEY, or BFL_API_KEY in the MCP server's env block.
Provider not available for requested media type
Each provider supports different media types (see Provider Capabilities). If you specify a provider that isn't configured (no API key) or doesn't support the requested media type, you'll receive an error. Omit the provider parameter to auto-select from configured providers.
Video generation timeout
Video generation polls for up to 10 minutes. If your video hasn't completed in that window, the request will fail with a timeout error. Try a shorter duration or a simpler prompt.
xAI image generation returned no data
This indicates the xAI API returned an empty response. Check that your XAI_API_KEY is valid and that your prompt does not violate xAI content policies.
Gemini image/video generation failed: 403
Verify your GEMINI_API_KEY has the Generative Language API enabled in Google Cloud Console.
Development
npm run build # Compile TypeScript to build/
npm test # Run tests with Vitest
npm run lint # Lint and auto-fix with ESLint
npm run typecheck # Type-check without emitting
npm run dev # Watch mode for TypeScript compilationEditor Setup
Replace OPENAI_API_KEY with your provider of choice (XAI_API_KEY, GEMINI_API_KEY, ELEVENLABS_API_KEY, BFL_API_KEY). You can set multiple keys to enable multiple providers.
Claude Desktop
Add to ~/Library/Application Support/Claude/claude_desktop_config.json:
{
"mcpServers": {
"multimodal-mcp": {
"command": "npx",
"args": ["@r16t/multimodal-mcp@latest"],
"env": {
"OPENAI_API_KEY": "sk-..."
}
}
}
}Cursor
Add to .cursor/mcp.json in your project root (or ~/.cursor/mcp.json globally):
{
"mcpServers": {
"multimodal-mcp": {
"command": "npx",
"args": ["@r16t/multimodal-mcp@latest"],
"env": {
"OPENAI_API_KEY": "sk-..."
}
}
}
}VS Code (GitHub Copilot)
Add to .vscode/mcp.json in your project root:
{
"servers": {
"multimodal-mcp": {
"command": "npx",
"args": ["@r16t/multimodal-mcp@latest"],
"env": {
"OPENAI_API_KEY": "sk-..."
}
}
}
}Windsurf
Add to ~/.codeium/windsurf/mcp_config.json:
{
"mcpServers": {
"multimodal-mcp": {
"command": "npx",
"args": ["@r16t/multimodal-mcp@latest"],
"env": {
"OPENAI_API_KEY": "sk-..."
}
}
}
}Cline
Add to ~/Library/Application Support/Code/User/globalStorage/saoudrizwan.claude-dev/settings/cline_mcp_settings.json:
{
"mcpServers": {
"multimodal-mcp": {
"command": "npx",
"args": ["@r16t/multimodal-mcp@latest"],
"env": {
"OPENAI_API_KEY": "sk-..."
}
}
}
}License
MIT
Available Tools
6 toolsedit_imageB
Edit an existing image using AI. Provide the path to an image and a text prompt describing the desired edits. Providers: openai, xai, google, bfl (FLUX Kontext). Available: none configured
Inputs: imagePath (required), prompt (required), provider, outputDirectory, +1 more.
generate_audioB
Generate audio from text using AI. Supports text-to-speech and sound effects. Providers: openai, google, elevenlabs. ElevenLabs: use providerOptions.mode = "sound-effect" for sound effects. Available: none configured
Inputs: text (required), provider, voice, speed, +3 more.
generate_imageB
Generate an image from a text prompt using AI. Providers: openai (DALL-E), xai (Aurora), google (Imagen), bfl (FLUX). Available: none configured
Inputs: prompt (required), provider, aspectRatio, quality, +2 more.
generate_videoC
Generate a video from a text prompt using AI. Optionally provide an image as the first frame. Available providers: none configured
Inputs: prompt (required), provider, duration, aspectRatio, +4 more.
list_providersA
List all configured media generation providers and their capabilities
Inputs: no named parameters.
transcribe_audioA
Transcribe audio to text using AI (speech-to-text). Providers: openai (Whisper), elevenlabs (Scribe). Available: none configured
Inputs: audioPath (required), provider, language, providerOptions.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 6 tools
Each tool targets a distinct media type and action (edit_image, generate_audio, etc.), with no overlap in purpose. An agent can easily distinguish them.
All tool names follow a consistent verb_noun pattern (e.g., generate_image, list_providers), making the API predictable and easy to navigate.
Six tools cover image, audio, video, and transcription domains. This is a well-scoped set for a multimodal server, not too few or too many.
Core generation and transcription tasks are covered, and editing is available for images. Missing audio/video editing and image-to-video, but overall it's a reasonable surface for common multimodal workflows.
Maintenance
Related MCP Connectors
Chat, image, video, and audio models from many vendors behind one remote MCP server and one key.
AI video, image and audio generation with 140+ AI models from any MCP agent
Generate images and videos with Seedance, Veo, Wan, Grok, GPT-Image and Nano Banana via one MCP.
Generate images, video, audio and short films with 140+ AI models from any MCP client.
Related MCP Servers
- AlicenseAqualityCmaintenanceMCP server for AI-powered image, audio, and video generation, enabling media creation directly from Claude, Cursor, and other MCP clients.1141 npmMIT
- AlicenseAqualityDmaintenanceMCP server for multi-provider AI image generation (AWS Bedrock, OpenAI, Google Gemini) enabling image generation, transformation, and editing through a unified interface.41MIT
- AlicenseAqualityFmaintenanceProduction-grade MCP server for image and video understanding and generation across Gemini, OpenAI, and Grok.587 PyPI4Apache 2.0
- AlicenseAqualityDmaintenanceMulti-provider AI video, speech, music, and transcription MCP server enabling video generation, image-to-video, TTS, music creation, and speech-to-text via a unified interface.3MIT