mcp-video-vision
Provides video analysis capabilities such as extracting frames, detecting scenes, and retrieving video metadata using ffmpeg and ffprobe.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@mcp-video-vision extract frames from /footage/demo.mp4 every 2 seconds"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
mcp-video-vision
MCP server em TypeScript que dá ao Claude a capacidade de "ver" vídeos — extraindo frames e detectando cenas — para uso como ferramenta de edição assistida por IA.
O que faz
Registrado no Claude Code via transporte stdio, expõe ferramentas que permitem ao assistente analisar vídeos sem precisar scrubbar a timeline manualmente.
Related MCP server: mcp-video
Tools disponíveis
Tool | Descrição |
| Metadata do vídeo (duração, fps, resolução, codec) via ffprobe |
| Extrai frames por fps fixo ou automático, com controle de resolução e formato |
| Detecta cortes de cena via ffmpeg com threshold ajustável |
| Extrai 1 frame de um timestamp exato |
| Tool principal: detecta cenas, mescla cortes curtos, extrai 1 frame representativo por plano e devolve log navegável com timecodes |
Requisitos
Node.js 18+
ffmpeg instalado e no PATH (inclui ffprobe)
Instalação
git clone https://github.com/danusiojr/mcp-video-vision
cd mcp-video-vision
npm install
npm run buildRegistrar no Claude Code
Adicione ao seu claude_desktop_config.json:
{
"mcpServers": {
"video-vision": {
"command": "node",
"args": ["/caminho/para/mcp-video-vision/dist/index.js"]
}
}
}Uso
Com o server registrado, use no Claude Code:
"analise o vídeo em /footage/EP011.mp4 e me dê a decupagem completa"
"quais cenas têm mais de 10 segundos nesse clipe?"
"extraia o frame do minuto 2:34 desse vídeo"
Stack
TypeScript · @modelcontextprotocol/sdk · ffmpeg/ffprobe · Node.js
Available Tools
8 toolscatalog_brollsCatalog B-rollsA
Analisa visualmente uma lista de clips de b-roll: roda decupagem em cada um e retorna o catálogo completo com frames representativos de cada plano. Use antes de match_edit para que o Claude veja o conteúdo visual disponível.
Inputs: video_paths (required), threshold, resolution, max_shots_per_clip.
decuparDecuparB
Tool-mãe de edição: detecta cenas, extrai 1 frame representativo por plano e devolve um log de conteúdo navegável (decupagem) sem precisar scrubbar a timeline.
Inputs: video_path (required), threshold, resolution, format, +4 more.
detect_scenesDetect ScenesB
Detecta cortes de cena via análise de diferença entre frames (ffmpeg scene detection). Retorna timestamps de corte com score de confiança — ideal para decupagem (1 frame por plano).
Inputs: video_path (required), threshold, start_time, end_time.
extract_framesExtract FramesC
Extrai frames do vídeo num intervalo fixo de fps. Use auto_fps=true (padrão) para deixar o servidor escolher o fps com base na duração do vídeo.
Inputs: video_path (required), start_time, end_time, fps, +4 more.
frame_atFrame AtB
Extrai um único frame de um timestamp exato. Útil para 'o que tem em 1:30?'.
Inputs: video_path (required), timestamp (required), resolution, format.
generate_xmlGenerate Premiere XMLA
Gera um arquivo XMEML (XML do Premiere Pro / FCP) a partir de uma lista de decisões de edição. Salva o arquivo em output_path e retorna o XML gerado. Importe no Premiere via File → Import.
Inputs: sequence_name (required), output_path (required), clips (required), fps, +2 more.
transcribeTranscribeA
Transcreve o áudio de um vídeo ou arquivo de áudio usando Whisper local. Retorna o texto completo com timestamps por segmento — essencial para alinhar narração/VO com b-rolls num fluxo de edição. Modelos disponíveis: tiny, base, small (padrão), medium, large-v3.
Inputs: video_path (required), model, language.
video_infoVideo InfoA
Lê metadata do vídeo (duração, fps, resolução, codec, tamanho) sem processar frames. Passo inicial barato antes de extrair frames ou detectar cenas.
Inputs: video_path (required).
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 8 tools
Most tools have clearly distinct purposes (e.g., transcribe, video_info, generate_xml). However, there is some overlap: decupar and detect_scenes both detect scenes, and catalog_brolls also extracts representative frames, which could cause confusion. The descriptions help differentiate but ambiguity remains for these tools.
Tool names mix English and Portuguese (catalog_brolls, decurpar vs. detect_scenes, extract_frames). Naming patterns are inconsistent: some are verb_noun (detect_scenes, extract_frames), others are noun_verb? (catalog_brolls) or single verbs (decupar). This inconsistency makes it harder to predict tool functions from names alone.
8 tools is an appropriate number for a video analysis and editing server. Each tool covers a distinct part of the workflow (metadata, scene detection, frame extraction, transcription, XML generation) without being overwhelming or too sparse.
The tool set covers the core video analysis pipeline: metadata extraction, scene detection, frame extraction, audio transcription, and XML export for editing. Minor gaps exist: no tool for searching within transcriptions or for directly combining scenes into edit decisions, but these are manageable for an agent.
Maintenance
Related MCP Connectors
MCP server for Wan AI video generation
MCP server for Clipkit — gives AI agents a video toolbox via the Clipkit schema.
MCP server for Google Veo AI video generation
Multimodal video analysis MCP — transcription, vision, and OCR for any video URL.
Related MCP Servers
FlicenseNot gradedqualityBmaintenanceMCP server enabling video analysis via scene detection, audio transcription, visual description, and stylistic fingerprinting, with tools for full pipeline execution and storyboard generation.-- AlicenseNot gradedqualityDmaintenanceAn MCP server that enables LLMs to analyze video content by extracting frames as base64 images and retrieving video metadata using ffmpeg.7 npmMIT
- AlicenseNot gradedqualityDmaintenanceAn MCP server that uses Google's Gemini API to analyze videos and convert them to text descriptions that Claude Code can understand and act upon.143 npmMIT
- AlicenseNot gradedqualityDmaintenanceAn MCP server for comprehensive video analysis — AI-powered transcription, visual frame analysis, and metadata extraction from 1000+ platforms.1MIT