Overview
media_overviewGenerate a readable overview of a local video, audio file, or document: storyboard grids with time-aligned text, timestamped transcripts, or page thumbnails with extracted text.
Instructions
Build an overview of a local media file so you can read it without guessing. (生成媒体总览：视频出分镜宫格图与按时间对齐的文本清单；录音出带时间轴的转写；文档出页面缩略图与每页文字。)
What you get depends on the media:
video : one or more numbered storyboard grids (each cell carries its cell number) plus a time-aligned text index of every cell
audio : a timestamped transcript, segment by segment
document : a grid of page thumbnails plus the text of each page, when a document parser is configured
TEXT SOURCE ORDER — subtitles first, ASR only as a fallback:
a transcriptFile you pass in (external subtitle file),
the subtitle track embedded in the container,
a subtitle file with the same base name in the same directory (a.srt next to a.mp4),
ASR — only when none of the above exists and an ASR provider is configured. Every segment is tagged with its source. subtitle = the author's own words, safe to quote. asr = machine transcription: names, numbers and jargon are often wrong, so do NOT quote an ASR segment verbatim and do not present it as the speaker's exact words. visual = there is no text at all, only the picture.
The storyboard grid is for FINDING things, not for reading them: cells are small, so text inside a cell is usually unreadable. To read text on screen, call media_zoom on that moment and read the cropped single frame.
The full text is NOT inlined. It is written to disk and the returned paths point at it: content.md (readable), segments.jsonl (one segment per line, machine-readable), manifest.json (what was produced and how). Read those files section by section and summarise them in chunks yourself — do not ask for the same range again just to get more inline text.
Always call media_probe first: it tells you how long the file is, whether a subtitle source exists, and which transcript source applies, for free. Long media must be narrowed with start/end (video, audio) or pages (document) — one giant grid of a two-hour film gives you illegible cells and spoils the ending. Follow the continuation hint in the result to page through the rest.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| end | No | Window end in seconds (closed interval, both ends included). Applicable to video and audio only. Defaults to the end of the media; a value past the end is clipped and reported. (终点，秒) | |
| path | Yes | Absolute path to a LOCAL file: video, audio recording, or document. URLs and relative paths are rejected — this server never downloads anything. (本地文件绝对路径) | |
| cells | No | Cells per puzzle image: storyboard shots for video, page thumbnails for document. 1-16; default 9 for video and 6 for document. Applicable to video and document only. (每张拼图的格数) | |
| pages | No | Page range for document media: comma-separated 1-based page numbers and closed ranges, e.g. "3-10,15". Not applicable to video or audio. (页码范围) | |
| start | No | Window start in seconds (closed interval, both ends included). Applicable to video and audio only; document media uses "pages" instead. Default 0. (起点，秒) | |
| images | No | How many puzzle images to return: 1-4, default 2. Applicable to video and document only. (返回几张拼图) | |
| maxEdge | No | Longest edge of each image in pixels: 256-1600. Default 1280 for overview, 1600 for zoom. Applicable to video and document only. (单张图最长边) | |
| segment | No | Window length in seconds (30-3600, default 300), used when only "start" is given. Applicable to video and audio only. | |
| envelope | No | Attach an audio envelope waveform image (default false). Applicable to audio recordings only. (音频包络图) | |
| transcript | No | "auto" (default): use subtitles first, ASR only as a fallback. "off": no transcription at all, visuals only. Applicable to video and audio only. | |
| transcriptFile | No | Absolute path to a local subtitle/transcript file (.srt, .vtt, .ass, .ssa). Applicable to video and audio only. (本地字幕/转写文件) |