Vibie MCP
README.md
<div align="center">
# š¬ Vibie MCP
### The Universal AI "Vibe Video Editor" MCP for FilmCraft & Adobe Premiere Pro
[](LICENSE)
[](https://nodejs.org/)
[](https://www.typescriptlang.org/)
[](https://modelcontextprotocol.io/)
[](https://github.com/storytold/filmcraft)
[](https://www.adobe.com/products/premiere.html)
**Vibie** is a next-generation Model Context Protocol (MCP) server that empowers AI assistants to edit video natively across **[FilmCraft](https://github.com/storytold/filmcraft)** (the open-source Premiere Pro clone in pure Rust) AND **Adobe Premiere Pro** (via an included 1-click CEP panel extension).
Powered by **TypeScript**, **FFmpeg**, **OpenCV**, and **HyperFrames (HeyGen)**.
</div>
---
## š Why Vibie?
Traditional video editing involves hours of repetitive friction: cutting dead air, syncing audio, hunting down clips, reframing 16:9 shots to 9:16 vertical reels, and building lower thirds.
**Vibie bridges human taste with agentic execution:**
- š **Dual-Engine Interoperability**: Seamlessly controls **FilmCraft** (native 127.0.0.1:9876 socket) OR **Adobe Premiere Pro** (included CEP panel on 127.0.0.1:9877). Auto-detects whichever NLE is running!
- šļø **Fast Assembly**: Remove silences and generate rough cuts in seconds with FFmpeg.
- šÆ **AI Object Masking**: Select subjects and generate organic polygon contours via OpenCV even before native AI masks land in FilmCraft.
- š± **Smart 9:16 Auto-Reframe**: Smoothly pan-and-scan horizontal footage for TikTok and YouTube Shorts by tracking faces.
- šØ **HyperFrames Graphics**: Render dynamic, animated lower thirds, chapter cards, and subtitles directly from HTML/CSS to timeline tracks `V2` and `V3`.
- š”ļø **Safe & Reviewable**: Every mutation generates structured audit receipts and undo checkpoints so you never lose work.
---
## šļø Architecture
```mermaid
flowchart TD
subgraph Client["AI Assistants"]
Claude["Claude Desktop / Claude Code"]
Cursor["Cursor / Windsurf / Codex"]
Agy["Google Antigravity"]
end
subgraph Vibie["Vibie MCP Server (TypeScript Host)"]
Router["Unified Bridge & Host Auto-Detector"]
Packs["Tool Packs (Essential, Editorial, Audio, Color, Vision, Full)"]
subgraph Intelligence["Open-Source Processing Engines"]
FFmpeg["FFmpeg Core\n⢠Silence detection\n⢠EBU R128 Loudness (-14 LUFS)\n⢠Scene change detection"]
OpenCV["OpenCV Vision Sidecar\n⢠AI Object Selection\n⢠Face & Subject Tracking\n⢠9:16 Auto-Reframe"]
Hyper["HyperFrames Engine\n⢠HTML/CSS Motion Graphics\n⢠Kinetic Typography\n⢠Animated Lower Thirds"]
end
end
subgraph Hosts["Connected NLE Video Editors"]
subgraph FilmCraftApp["FilmCraft (Free & Open Source)"]
FCSocket["Native TCP Loopback (127.0.0.1:9876)"]
FCTimeline["Timeline Engine (Exact Integer Ticks)"]
end
subgraph PremiereApp["Adobe Premiere Pro"]
CEPExt["Vibie CEP Extension Panel (127.0.0.1:9877)"]
PPRODOM["Premiere Pro ExtendScript DOM Engine"]
end
end
Client <--> Vibie
Vibie <--> FFmpeg & OpenCV & Hyper
Router -->|Auto-Route| FCSocket
Router -->|Auto-Route| CEPExt
FCSocket <--> FCTimeline
CEPExt <--> PPRODOM
```
---
## š§° Available Tools & Domains
| Domain | Tool Name | Description |
| :--- | :--- | :--- |
| **Host Control** | `vibie_detect_hosts` | Detects whether FilmCraft, Adobe Premiere Pro, or both are online. |
| | `vibie_set_target_host` | Switch active editing destination between `filmcraft`, `premiere`, or `auto`. |
| **Inspection** | `filmcraft_inspect_timeline` | Deep scan of active sequence, tracks, clips, and playhead. |
| | `filmcraft_capture_frame` | Grab the Program Monitor frame for visual AI inspection. |
| | `filmcraft_add_marker` | Add timestamped editorial feedback notes and colored markers. |
| **Timeline** | `filmcraft_place_clip` | 3-point insert/overwrite media onto tracks (`V1`, `V2`, `A1`, `A2`). |
| | `filmcraft_razor_cut` | Split clips across tracks at exact second or playhead timecode. |
| | `filmcraft_ripple_delete` | Remove clips or empty gaps and auto-close spacing. |
| | `filmcraft_slip_slide` | Micro-adjust clip in/out points while preserving timeline position. |
| | `filmcraft_silence_remover` | Auto-detect dead air with FFmpeg and batch ripple-delete. |
| **Audio** | `filmcraft_audio_gain` | Normalize clip peaks or set decibel levels. |
| | `filmcraft_essential_sound_ducking` | Auto-duck background music beds beneath dialogue. |
| | `filmcraft_measure_loudness` | Check broadcast EBU R128 loudness and gain offsets to -14 LUFS. |
| **Color** | `filmcraft_lumetri_grade` | Fine-tune exposure, contrast, temperature, highlights, and shadows. |
| | `filmcraft_lumetri_match` | Match color grading between two clips using reference timecodes. |
| **Vision** | `filmcraft_object_select_mask` | Isolate people or subjects with organic polygon mask contours. |
| | `filmcraft_auto_reframe_vertical` | Pan-and-scan horizontal video to vertical 9:16 Shorts with face tracking. |
| **Graphics** | `filmcraft_generate_lower_third` | Render sleek animated speaker overlays with HyperFrames. |
| | `filmcraft_generate_title_card` | Render kinetic typography title cards. |
| **Export** | `filmcraft_export_sequence` | Trigger hardware NVENC/VideoToolbox or software render exports. |
| | `filmcraft_export_markers` | Export sequence review notes to CSV. |
---
## ā” Quickstart
### 1. Requirements
* **Node.js** v20+
### 2. Connect Your Editor
#### For FilmCraft (Free & Open Source):
Run FilmCraft with the control flag:
```bash
# Windows: Double-click extensions/filmcraft/launch-control.bat or run:
filmcraft --control 9876
```
#### For Adobe Premiere Pro:
Install the included 1-click CEP panel:
* **Windows**: Double-click `extensions/premiere/install-premiere.bat`
* **macOS**: Run `bash extensions/premiere/install-premiere.sh`
* Then launch Premiere Pro and open: **Window > Extensions > Vibie MCP Bridge**.
---
### 3. Setup in Claude Desktop (`claude_desktop_config.json`)
```json
{
"mcpServers": {
"vibie": {
"command": "node",
"args": ["d:/MCP Vibie/dist/index.js"],
"env": {
"VIBIE_TARGET": "auto",
"VIBIE_PACK": "full"
}
}
}
}
```
### 4. Setup in Cursor (`.cursor/mcp.json`)
```json
{
"mcpServers": {
"vibie": {
"command": "node",
"args": ["d:/MCP Vibie/dist/index.js"]
}
}
}
```
---
## šÆ Pre-Built Workflow Prompts
Vibie includes guided prompts out of the box:
* **`vibie_rough_cut`**: Ingest footage, detect pauses with FFmpeg, ripple-delete silences, and normalize dialogue to -14 LUFS.
* **`vibie_podcast_shorts_generator`**: Convert a podcast moment into a 9:16 vertical short, track the speaker, duck background music, and add a lower third.
* **`vibie_ai_object_mask`**: Inspect the frame and segment subjects using OpenCV contours.
---
## š¤ Contributing & Community
Vibie is 100% open-source under the **MIT License**. Contributions, issues, and feature requests are welcome!
Made with ā¤ļø for both the **FilmCraft** open-source community and the global **Premiere Pro** editorial community.
This server cannot be deployed
Maintenance
ActivityMaintained
ResponsivenessNo issues