ElevenLabs Voice-to-Voice Agent
Provides tools to interact with ElevenLabs voice AI, including text-to-speech, speech-to-text, voice management, and history retrieval.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@ElevenLabs Voice-to-Voice Agentstart a voice session about artificial intelligence"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
ElevenLabs Voice-to-Voice Agent — MCP Server
A full voice-to-voice AI agent built on the Model Context Protocol. Speak into your microphone, the agent thinks, and ElevenLabs speaks back — all orchestrated through MCP tools, prompts, and resources.
Works with Anthropic Claude or OpenAI GPT — no Claude Desktop required.
MCP Primitives Implemented
Tools (7)
Tool | Description |
| List all available ElevenLabs voices |
| Get detailed info about a specific voice |
| List available TTS/STT models |
| Convert text → MP3, save to disk |
| Transcribe an audio file → text |
| Account and character usage info |
| Retrieve generation history |
Prompts (4) — prompt-centric MCP
Prompt | Args | What it does |
|
| Creates a named agent persona; picks the best matching voice and speaks every reply aloud |
|
| Initialises a live voice loop — agent listens and responds in spoken audio |
|
| Lists voices, picks top 3 for the role, generates audio samples for each |
|
| Renders the same phrase across N diverse voices for side-by-side comparison |
Resources (2)
URI | Description |
| Live voice list — IDs, categories, labels |
| Available TTS/STT models and capabilities |
Related MCP server: ElevenLabs MCP Server
Prerequisites
Node.js ≥ 18
sox (for microphone recording in
/voicemode)brew install sox # macOS sudo apt install sox # Ubuntu/Debian
Setup
npm install
npm run buildEnvironment Variables
Variable | Required | Description |
| Yes | ElevenLabs API key |
| No |
|
| If using Anthropic | Claude API key |
| If using OpenAI | GPT API key |
| No | Where MP3 files are saved (defaults to cwd) |
Export before running (the server reads from process.env directly — .env is not auto-loaded):
export ELEVENLABS_API_KEY="your-key"
export LLM_PROVIDER="anthropic"
export ANTHROPIC_API_KEY="your-key"Usage
Start the client
npm run clientElevenLabs Voice Agent — MCP Client (provider: anthropic)
Connected! 7 tools: list_voices, get_voice, list_models, text_to_speech, speech_to_text, get_user_info, get_history
Commands: /prompts /prompt <name> [args] /voice exitText chat
You: List all available voices
[tool: list_voices]
Assistant: Here are the available voices...
You: Convert "Welcome to my demo" to speech using a deep male voice
[tool: list_voices]
[tool: text_to_speech]
Assistant: Audio saved to: ./output_1234.mp3List and invoke prompts
You: /prompts
Available prompts:
voice_agent_persona — Create a voice AI agent with a specific persona...
args: name, personality, [voice_style]
start_voice_session — Initialize a live voice conversation...
args: [topic], [language], [voice_id]
find_voice_for_role — Analyze and recommend voices for a use case...
args: role
voice_showcase — Render a phrase in multiple voices...
args: phrase, [count]
You: /prompt voice_agent_persona name="Aria" personality="warm and professional"
[tool: list_voices]
[tool: text_to_speech]
Assistant: Hi, I'm Aria! How can I help you today?
[Audio plays automatically]Voice conversation mode
You: /voice
[Voice Mode] The agent will listen and speak back.
[Voice Mode] Type 'exit' at any prompt to return to text mode.
Press ENTER to speak (or type 'exit'):
Recording... Press ENTER to stop:
Transcribing...
You: "What voices does ElevenLabs have?"
[tool: list_voices]
[tool: text_to_speech]
Assistant: ElevenLabs has over 30 voices...
[Audio plays automatically]
Press ENTER to speak (or type 'exit'): exit
[Returned to text mode]ElevenLabs API Key Permissions
When creating your API key, enable:
Permission | Setting |
Text to Speech | Access |
Speech to Text | Access |
Voices | Read |
Models | Access |
History | Read |
User | Read |
Everything else can stay at No Access.
With Claude Desktop
Add to claude_desktop_config.json:
{
"mcpServers": {
"elevenlabs": {
"command": "node",
"args": ["/absolute/path/to/build/index.js"],
"env": { "ELEVENLABS_API_KEY": "your-key" }
}
}
}With Claude Code
claude mcp add elevenlabs node /absolute/path/to/build/index.jsArchitecture
src/
elevenlabs-client.ts — ElevenLabs REST API wrapper (TTS + STT + voices + models)
index.ts — MCP server: 7 tools, 4 prompts, 2 resources
client.ts — CLI client: text REPL + /voice loop + /prompt commandsYou (mic/keyboard)
│
▼
client.ts ──────────────────────────────► LLM API (Claude / GPT)
│ MCP stdio transport │
▼ │ tool calls
index.ts (MCP Server) ◄────────────────────────┘
│
▼
elevenlabs-client.ts ──► ElevenLabs REST API
(TTS + STT + voices + models)Voice loop flow:
Mic → sox → WAV file
speech_to_texttool → transcript textLLM (with
VOICE_SYSTEMprompt) → text response +text_to_speechcalltext_to_speechtool → MP3 fileafplay/mpg123→ audio plays from speakersLoop back to step 1
License
MIT
This server cannot be installed
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Latest Blog Posts
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/Begwen/Agentic-Voice-AI-System---MCP-Native-'
If you have feedback or need assistance with the MCP directory API, please join our Discord server