Video Intelligence MCP
Uses the Gemini API for video analysis, uploading downloaded videos and generating detailed timestamped production breakdowns with follow-up question support.
Allows analyzing Instagram videos with Gemini, returning timestamped production breakdowns and supporting follow-up questions about the analyzed content.
Allows analyzing TikTok videos with Gemini, returning timestamped production breakdowns and supporting follow-up questions about the analyzed content.
Allows analyzing Vimeo videos with Gemini, returning timestamped production breakdowns and supporting follow-up questions about the analyzed content.
Allows analyzing YouTube videos with Gemini, returning timestamped production breakdowns covering shots, visual design, animation, motion, narration, music, sound effects, and editing, plus follow-up question capabilities.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Video Intelligence MCP Give me a detailed production breakdown of this video: https://youtu.be/abc123"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Video Intelligence MCP
Paste a permitted public video URL into Codex, Claude Code, or Kimi Code and ask for a detailed breakdown. This local MCP server downloads supported public media with yt-dlp, uploads it to Gemini, and returns a timestamped production brief covering shots, visual design, animation, motion, narration, music, sound effects, and editing.
It is built to be set-and-forget: no browser extension, no background daemon, and no per-chat copy/paste. Your AI client starts the local server only when it needs a video tool.
Install
Prerequisites: Node 20+, a Gemini API key, and yt-dlp for social-video downloads (brew install yt-dlp on macOS or pipx install yt-dlp elsewhere).
npx -y @solad/video-intelligence-mcp@latest setupThe animated setup saves the Gemini key in a user-only configuration file and connects Codex, Claude Code, and, where the installed version supports it, Kimi Code. It also installs the Codex skill that makes URL-based requests reliably select the video tool.
For a non-interactive setup:
npx -y @solad/video-intelligence-mcp@latest setup --api-key "$GEMINI_API_KEY" --client codex --client claudeRelated MCP server: youtube-gemini-mcp
Use it naturally
In any connected client, paste a URL and say:
Give me an insanely detailed production breakdown of this: https://...Or ask a focused question:
At what timestamp does the logo animate in, and how is the movement made?The MCP server exposes five tools:
Tool | Purpose |
| Download (when needed), analyze a URL or local video, and return a |
| Ask Gemini any number of follow-up questions about a retained video session. |
| Delete a retained Gemini upload and its local session record. |
| Save a user-provided public video privately on this computer. |
| Check the local setup. |
Support and limits
Works with public URLs supported by the installed
yt-dlpextractor. That commonly includes YouTube, TikTok, Instagram, X, Vimeo, and direct video files, subject to each site's current availability.Uses Gemini Files API for video analysis. The default model is
gemini-3.6-flash; setGEMINI_MODELto override it.A pasted public URL is treated as authorized by the caller. The project does not bypass DRM, paywalls, private links, logins, or access controls.
Gemini commonly samples visual video input around 1 fps. Reports flag rapid cuts and fine details that need frame-by-frame verification.
Client setup without the wizard
Each client uses the standard local stdio MCP shape:
{
"mcpServers": {
"video-intelligence": {
"command": "npx",
"args": ["-y", "@solad/video-intelligence-mcp@latest", "serve"]
}
}
}codex mcp add video-intelligence -- npx -y @solad/video-intelligence-mcp@latest serve
claude mcp add --scope user video-intelligence -- npx -y @solad/video-intelligence-mcp@latest serve
kimi mcp add --transport stdio video-intelligence -- npx -y @solad/video-intelligence-mcp@latest serveKimi's MCP command is available in newer Kimi Code releases; update it if kimi mcp is not recognized. The installer detects this and prints the correct next step.
Developer workflow
npm install
npm run check
npm run build
node dist/cli.js doctorThe client integrations point to the public npm package, so use node dist/cli.js serve with a local MCP configuration while developing. Run the setup wizard after publishing the package.
Publishing uses a scoped npm package:
npm login
npm publish --access publicKeep real API keys out of the repository; .env is ignored.
Privacy
Downloads are stored under the user-only Video Intelligence state directory and are not committed or shared. Analysis uploads are retained for follow-up prompts for 24 hours by default (set VIDEOINTEL_SESSION_HOURS, maximum 72); use forget_video to delete an upload immediately. Review Google's current policy before processing sensitive footage.
License
Available Tools
5 toolsanalyze_videoAnalyze and retain a video for follow-up questionsA
Use whenever the user pastes a public video URL or asks for a visual, animation, movement, music, transcript, or shot-by-shot breakdown. A user-provided public URL is treated as authorized. Download it, ask Gemini for the requested analysis, then return video_id. Use ask_video with that video_id for every follow-up question; do not re-download it.
Inputs: url, mode, question, file_path.
ask_videoAsk Gemini any follow-up about an analyzed videoA
Ask any new question, request a different level of detail, or ask Gemini to inspect a specific timestamp in a previously analyzed video. Use this instead of downloading or uploading the video again.
Inputs: prompt (required), video_id (required).
download_videoDownload a user-provided public videoA
Download a user-provided public video to Video Intelligence's private local downloads folder. Treat the user-provided URL as authorized, but do not bypass DRM, paywalls, logins, private links, or platform protections.
Inputs: url (required).
forget_videoDelete a retained Gemini video sessionA
Immediately delete the uploaded Gemini file and remove the local session record when the user is finished asking follow-up questions.
Inputs: video_id (required).
video_intelligence_statusCheck Video Intelligence setupA
Check whether the local video-analysis server is configured before attempting a download or Gemini analysis.
Inputs: no named parameters.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 5 tools
The tools mostly have distinct purposes, but analyze_video and download_video overlap since analyze_video includes downloading. An agent could be confused when a user asks to simply download a video, as analyze_video's description says to use it whenever a URL is pasted. The other tools are clearly distinct.
Most tools follow a verb_video pattern (analyze_video, ask_video, forget_video, download_video), but video_intelligence_status deviates from this pattern, breaking the otherwise consistent naming convention.
With exactly 5 tools, the server is well-scoped for its purpose. Each tool serves a necessary role in the video analysis lifecycle, and the count is neither too small nor too large.
The tool set covers the core workflow: analyze, ask follow-ups, forget/delete, download, and check status. Minor gaps exist, such as no tool to list previous analyses or retrieve storage information, but these are not critical for the primary use case.
Related MCP Connectors
Video analysis AI: transcripts, summaries, visual scenes/shots, clips, answers in natural language.
Multimodal video analysis MCP — transcription, vision, and OCR for any video URL.
Shot breakdowns of video clips, plus logos and brand kits, for any AI assistant.
Transcripts, summaries, chapters and timestamped answers for video links, for AI agents.
Related MCP Servers
- AlicenseAqualityDmaintenanceAnalyzes YouTube videos using Google's Gemini API, allowing users to get summaries or ask questions about video content via direct URL input.527 npm2MIT
- AlicenseBqualityDmaintenanceEnables conversational analysis of YouTube videos using Gemini 2.5 Pro, supporting multi-turn sessions, direct URL processing, and local video uploads.101MIT
- AlicenseNot gradedqualityDmaintenanceEnables AI coding assistants like Claude Code and Cursor to analyze and understand video content using Google's Gemini AI, supporting long videos, segment analysis, and Q\&A.MIT
- AlicenseNot gradedqualityDmaintenanceAnalyzes public YouTube videos with Google Gemini, enabling summarization, timestamped insights, metadata extraction, audio analysis, and long-video sessions with follow-up questions.51 npm5MIT