watch_video
Extract timestamped video frames and the matching transcript for a chosen time range. Use even or scene-based sampling to inspect slides, demos, and on-screen details.
Instructions
'Watch' a video: returns frames (images, each labelled with timestamp) plus the transcript for the same range. mode='even' spaces frames evenly; mode='scenes' samples twice as many moments and keeps the ones that differ most (best for slides, demos, edited videos). Use start/end ('90', '1:30') to zoom in and call again for detail. n_frames max 24 (default 6); width 512 saves tokens, raise to ~768 only to read small on-screen text (or use ocr_frames).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "watch_video"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| end | No | ||
| url | Yes | ||
| lang | No | auto | |
| mode | No | even | |
| start | No | ||
| width | No | ||
| n_frames | No | ||
| include_transcript | No |