opencine

 ██████╗ ██████╗ ███████╗███╗   ██╗     ██████╗██╗███╗   ██╗███████╗
██╔═══██╗██╔══██╗██╔════╝████╗  ██║    ██╔════╝██║████╗  ██║██╔════╝
██║   ██║██████╔╝█████╗  ██╔██╗ ██║    ██║     ██║██╔██╗ ██║█████╗
██║   ██║██╔═══╝ ██╔══╝  ██║╚██╗██║    ██║     ██║██║╚██╗██║██╔══╝
╚██████╔╝██║     ███████╗██║ ╚████║    ╚██████╗██║██║ ╚████║███████╗
 ╚═════╝ ╚═╝     ╚══════╝╚═╝  ╚═══╝     ╚═════╝╚═╝╚═╝  ╚═══╝╚══════╝

https://github.com/user-attachments/assets/bbb318d6-0323-4017-a8db-fd7f4601558b

Open Cine gives any agent (Claude Code, Codex, Cursor, Gemini CLI, OpenCode, …) a director's playbook (skills) and a video engine (MCP server). The agent plans the edit; the engine does the deterministic work (scene detection, beat-synced cuts, tracked 9:16 crops, captions, rendering), and generation runs on private duplicates of Hugging Face ZeroGPU Spaces in your own account.

Sample film

A short film made with Open Cine.

https://github.com/user-attachments/assets/c56cb3aa-8a1e-4fc8-8deb-0816c911908a

Related MCP server: OCC-ForAgent

Requirements

• A Hugging Face PRO account and a token with write access (settings/tokens)

• uv, FFmpeg ≥ 7 (libass, libx264, zscale), git

• Node.js ≥ 22 (motion and scribble layers, MCP registration)

Vibe install

Paste this into your agent:

Set up Open Cine for me: https://github.com/tranlamm/open-cine
Follow skills/opencine-setup/SKILL.md in that repo.

The agent checks the tools, installs the engine, has you enter your HF token, creates your Spaces and registers the MCP server. Restart the agent when it is done.

Install

Any agent

npx skills add tranlamm/open-cine

Then ask your agent: “Set up Open Cine.” The opencine-setup skill installs the engine, asks for your HF token, creates your Spaces and registers the MCP server.

Claude Code plugin

/plugin install open-cine --marketplace tranlamm/open-cine

Enter your Hugging Face token when prompted (stored in the system keychain), then ask “Set up Open Cine” to create your Spaces.

Manual

git clone https://github.com/tranlamm/open-cine ~/.opencine/engine
uv --directory ~/.opencine/engine sync
uv --directory ~/.opencine/engine run opencine setup

opencine setup checks the tools, saves the token to ~/.opencine/.env, creates the Spaces, installs the renderer and registers the MCP server with your agents via add-mcp. For any other MCP client, add a stdio server named opencine:

uv --directory ~/.opencine/engine run --quiet opencine mcp serve

Optional extras: uv --directory ~/.opencine/engine sync --extra vision (scribbles that find named objects with Florence-2 + EdgeTAM), --extra mask (SAM 2.1 mask wipes).

Usage

Talk to your agent:

Cut a 30-second reel from ~/Videos/lisbon/, upbeat, end on the sunset.
Make a 20-second noir short: a detective finds a letter in the rain.
Swap the dancer in ~/clips/dance.mp4 with the character in ~/refs/robot.png.

The agent stops at review gates and waits for you:

Answer in plain words: all ok · ok 1,3; 2 lower camera angle · cancel. Your taste (pacing, transitions, text density) is remembered across projects. Projects live in ~/.opencine/projects/<pid>/.

Telegram and Hermes (optional)

Review on Telegram. Create a bot with @BotFather and send it a message, then run:

uv --directory ~/.opencine/engine run opencine setup --telegram --no-spaces --no-fx --no-mcp

It asks for the bot token, reads your chat id from that message and sends a test message. The agent then posts gates and finals with the telegram_send tool. If Hermes already polls the same bot, add --telegram-chat <your user id>.

Hermes Agent. Talk to the agent from Telegram through the Hermes gateway. With Hermes installed and its Telegram gateway set up (hermes gateway setup):

uv --directory ~/.opencine/engine run opencine setup --hermes --no-spaces --no-fx
hermes gateway restart

This adds skills/ to Hermes (skills.external_dirs) and registers the MCP server (add-mcp -a hermes). Send footage to your bot (the public Bot API takes files up to 20 MB) and ask for a video. Without the Telegram tool, Hermes attaches review files through MEDIA: lines. Recommended: hermes config set display.busy_input_mode queue, so a new message waits instead of interrupting a long turn.

opencine --help lists every command.

skills/          agent skills: opencine-edit, opencine-film, opencine-swap, opencine-setup
src/opencine/    engine: ingest · index · plan · render · gen · review · mcp
fx/              Remotion renderer for the motion and scribble layers
.claude-plugin/  Claude Code plugin and marketplace

Contributing

See CONTRIBUTING.md.

License

The code is released under the Apache License 2.0. The bundled fonts (Anton, Montserrat) are under the SIL Open Font License.

The models and Spaces the engine calls keep their own licences, and several are non-commercial or own-use only (marked † below). Check them before any commercial use. The fx/ renderer uses Remotion, which is free for individuals and small teams; larger companies need a Remotion company license.

Acknowledgements

Open Cine stands on the work of these model authors, Space maintainers and tool builders. Thank you.

Generation (Hugging Face ZeroGPU Spaces)

1. Qwen Team. Qwen-Image-2.1. Space Qwen/Qwen-Image-2.1. Qwen Research License †

2. MiniMax. MiniMax-H3. Spaces multimodalart/minimax-h3, MiniMaxAI/MiniMax-H3-Turbo-Lora, conditioner multimodalart/qwen3vl-conditioner. MiniMax-H3 Community License †

3. larryvrh. MiniMax-H3 Turbo LoRA, via MiniMaxAI/MiniMax-H3-Turbo-Lora. Apache-2.0

4. Alissonerdx. MiniMax-H3 character-swap LoRA v1.1 and LMS LoRA. Alissonerdx/Minimax-H3-ComfyUI; Space linoyts/minimax-h3-character-swap. BFS Character Swap licence, own use only †

5. LightX2V. Distillation LoRAs for fast Ref2VA sampling. huggingface.co/lightx2v

6. LBH-123-AI. MiniMax-H3 latent upscaler. LBH-123-AI/Minimax_h3_latent_Upscaler

7. SCAIL-2. Space fffiloni/SCAIL-2. MIT weights, Apache-2.0 code

8. Lightricks. LTX-2.3 with Union-Control IC-LoRA. Space linoyts/LTX-2-3-sync. LTX-2 Community License †; Gemma 3 text encoder under the Gemma terms

9. FlashVSR+. Space hugging-apps/flashvsr-plus. Apache-2.0

10. ACE-Step 1.5. Space ACE-Step/Ace-Step-v1.5. MIT

Local vision

11. Microsoft. Florence-2-base-ft, ONNX by onnx-community. MIT

12. Meta. EdgeTAM, via yonigozlan/EdgeTAM-hf and jax-image-tools/edgetam-video-onnx. Apache-2.0

13. Meta. SAM 2.1 tiny, ONNX by vietanhdev. Apache-2.0

14. Depth Anything V2 Small, ONNX by onnx-community. Apache-2.0

15. OpenCV Zoo. YuNet face detector. opencv/face_detection_yunet. MIT

16. Real-ESRGAN (xinntao/Real-ESRGAN, BSD-3-Clause) and RIFE ncnn (nihui/rife-ncnn-vulkan, MIT) for final upscaling and interpolation

Tools: FFmpeg, Remotion, PySceneDetect, librosa, OpenCV, MCP Python SDK, gradio_client, huggingface_hub, skills, add-mcp, Hermes Agent. Fonts: Anton, Montserrat.

Star History