Video Analyze
video_analyzeAnalyze YouTube videos or local video files with custom instructions to extract structured JSON insights, summaries, commands, recipes, or schema-defined results.
Instructions
Analyze a video (YouTube URL or local file) with any instruction.
Provide exactly one of url or file_path. Uses Gemini's structured output for reliable JSON responses. Pass a custom output_schema to control the response shape, or use the default VideoResult schema.
When strict_contract=True, runs the full contract pipeline: analysis with strict Pydantic models, parallel strategy/concept-map generation, artifact rendering, and structural quality gates. Factual/media review and observed coverage remain explicit pending/unknown fields. Returns richer output but takes longer.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| fps | No | Local files only: requested static sampling frames per second; observed coverage remains unknown | |
| url | No | YouTube video URL. | |
| dry_run | No | Plan source reads/sends without provider calls | |
| file_path | No | Path to a local video file. | |
| use_cache | No | Use cached results | |
| end_offset | No | Local source interval end using h/m/s units; timestamps retain the original source origin | |
| instruction | No | What to analyze — e.g. 'summarize key points', 'extract all CLI commands shown', 'list all recipes and ingredients' | Provide a comprehensive analysis of this video. |
| start_offset | No | Local source interval start, using h/m/s units, for example '27m' or '1m30.5s' | |
| output_fields | No | Select top-level response fields; complete source/citation/provenance carriers remain included | |
| output_schema | No | Optional JSON Schema for the response. If omitted, uses default VideoResult schema. | |
| thinking_level | No | Gemini thinking depth. | high |
| strict_contract | No | Enable strict contract pipeline with quality gates, artifact rendering, and structural validation. Factual/media review and observed coverage remain explicitly pending or unknown. Produces richer output with strategy report, concept map, and HTML/Markdown artifacts. | |
| execution_budget | No | Explicit max_calls/max_tokens/max_output_tokens/max_frames/max_windows and start_ms/end_ms/fps. Bounded execution skips optional enrichment and cache reuse. | |
| transcript_limit | No | Page a top-level transcript string without truncating stored evidence or citations | |
| transcript_offset | No | Original custom-schema transcript string offset in Unicode code points |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||