analyze_video
Analyzes videos locally, detecting scenes and actions, and answering time-specific questions via deep reading. Generates contact sheets and frame data, all on-device.
Instructions
Analyze a video with a local vision model: scenes, actions, time-window deep reading, contact sheets, etc. Returns JSON: {"text": ..., "mode": ..., "frames": [{"t": ..., "w": ..., "h": ...}], "duration": ...}.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| to | No | window end | |
| fps | No | Sampling frame rate | |
| from | No | window/burst start, e.g. 1:20 | |
| mode | No | auto | |
| video | Yes | Video path / URL | |
| prompt | Yes | Question or instruction | |
| max_frames | No | Frame cap |