AI Sound MCP Server
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
What is AI Sound?
AI Sound is an AI-native audio editor designed as a modern replacement for desktop tools like Audacity. Instead of bolting AI onto an existing app, AI Sound is built from the ground up with LLM integration at its core — enabling conversational audio editing, automatic transcription, speaker diarization, and semantic search across your audio content.
It works with any OpenAI-compatible API — run it fully local with Ollama, or connect to OpenAI, Groq, or any other compatible provider. No vendor lock-in, no API keys required for local use.
AI Sound also exposes a full MCP (Model Context Protocol) server, letting AI assistants like Claude Desktop directly edit, analyze, and export your audio projects.
Key Features
Multi-track editing — import, arrange, and mix multiple audio tracks
AI-powered transcription — speech-to-text with word-level timestamps
Speaker diarization — automatically identify and split by speaker
Semantic search — find content by meaning, not just keywords
Audio effects — normalize, compress, EQ, reverb, noise reduction, fade, pitch shift, speed
Non-destructive editing — full undo/redo history
Export — export individual tracks or full project mixes
MCP integration — expose all editing tools to AI assistants
Related MCP server: Tonn MCP Server
Quickstart
Prerequisites
Bun — JavaScript/TypeScript runtime
FFmpeg — audio processing (
brew install ffmpegon macOS)An OpenAI-compatible LLM — Ollama for local, or any cloud provider
Install & Run
git clone https://github.com/your-username/ai-sound.git
cd ai-sound
bun install
bun run devOpen http://localhost:5175 in your browser.
On first launch, configure your LLM provider in Settings (gear icon). The default is Ollama at localhost:11434.
LLM Configuration
AI Sound works with any OpenAI-compatible API. Configure your provider in-app via Settings — no .env files needed.
Provider | Base URL | Model Example |
Ollama (local) |
|
|
OpenAI |
|
|
Anthropic (via proxy) | provider-specific |
|
Groq |
|
|
For cloud providers, enter your API key in the Settings panel. For Ollama, no API key is needed.
MCP Server
AI Sound includes a built-in Model Context Protocol server, allowing AI assistants like Claude Desktop to interact with your audio projects programmatically.
Claude Desktop Configuration
Add the following to your Claude Desktop config (~/Library/Application Support/Claude/claude_desktop_config.json):
{
"mcpServers": {
"ai-sound": {
"command": "bun",
"args": ["run", "/absolute/path/to/ai-sound/server/lib/mcp/server.ts"]
}
}
}Replace /absolute/path/to/ai-sound with the actual path to your installation.
Available Tools
Project Management
list_projects— List all projectsset_active_project— Set the active project for subsequent operationsget_project_status— Get all tracks, durations, regions, and transcriptionsget_track_info— Get detailed info about a specific track
Audio Effects & Processing
normalize_audio— Normalize audio levelsadjust_volume— Adjust volume by relative dB amounttrim_audio— Trim to a specific time rangeremove_silence— Detect and remove silent sectionsapply_fade— Apply fade in/outapply_effect— Apply effects: noise reduction, compressor, EQ, reverb, speed, pitch shift
Segment Operations
remove_segments— Remove multiple time ranges from a trackreplace_audio_segment— Replace a time range with silence or a beep
Track Operations
rename_track— Rename a trackdelete_track— Delete a track and its audiomerge_tracks— Merge multiple tracks into oneduplicate_track— Duplicate a trackexport_audio— Export a track or full project mix
Transcription & Search
transcribe_track— Transcribe audio using speech-to-textsplit_by_speaker— Split a track by speakerrename_speaker— Rename a speaker labelsearch_transcription— Search transcription text by patternsearch_transcript_semantic— Semantic search across transcriptionscopy_transcriptions— Copy transcription data between tracks
Tech Stack
Layer | Technology |
Runtime | |
Server | |
Database | SQLite via Drizzle ORM |
Frontend | |
Audio | |
AI Integration | OpenAI-compatible API + MCP SDK |
License
MIT
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
AI video editor for agents and humans: timeline, captions, color, audio and generation as MCP tools.
Remote MCP server for audio stem separation, denoise, reverb, and MIDI export.
Compose, edit and render video with your AI agent. Turn footage into finished edits with content-aware reframing, word-timed captions and motion graphics. Hosted MCP with OAuth sign-in; cloud processing uses credits.
Build and run AI workflows, agents, data tables and 1000+ API integrations from any MCP client.
Related MCP Servers
- AlicenseNot gradedqualityBmaintenanceEnables AI models to fully automate and control the OpenCut Video Editor through a comprehensive set of MCP tools for timeline manipulation, scene management, media handling, and rendering.71 npm10MIT
- AlicenseNot gradedqualityDmaintenanceEnables AI assistants to mix, master, and analyze audio using the RoEx Tonn API through MCP tools.2MIT
- AlicenseCqualityBmaintenanceEnables podcast producers and agents to manage multitrack projects, run per-track transcription, perform transcript-driven edits, process audio via FFmpeg, and inspect a read-only DAW timeline over MCP.218AGPL 3.0
- AlicenseBqualityCmaintenanceEnables MCP-capable AI agents to control REAPER through typed tools and a Lua escape hatch for project creation, track management, recording and editing, MIDI writing, mixing, rendering, and batch operations.501MIT