Full video analysis
video_analyzeResolve any video source into transcript, keyframes, OCR text, timeline, and summary for instant understanding of video content.
Instructions
Most powerful one-shot tool: resolve source → probe → transcript + keyframes (parallel) → OCR on-screen text → merged timeline + agent summary.
Prefer this when the user asks to "watch", "summarize", or "understand" a video. Use detail=brief for long lectures when only speech matters; detailed for short UI demos.
Returns: at-a-glance summary, metadata, transcript, OCR text, frame paths (+ evenly spaced inline thumbs), timeline, warnings.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | No | ||
| detail | No | brief=metadata+transcript only; standard=scene frames+transcript; detailed=dense frames | standard |
| source | Yes | Absolute local path, file:// URI, direct media URL, or platform URL (YouTube/TikTok/etc via yt-dlp) | |
| end_sec | No | ||
| language | No | ||
| skip_ocr | No | Skip tesseract OCR on keyframes | |
| start_sec | No | ||
| max_frames | No | ||
| skip_frames | No | ||
| force_refresh | No | ||
| inline_images | No | ||
| response_format | No | Response text format | markdown |
| skip_transcript | No |