Video Description
video_descriptionIndex what happens on screen in a video as timestamped events, scenes, and metadata by passing a video URL or file; use it for visual content, not audio speech.
Instructions
Describe what happens on screen in a video, as a timestamped index of events.
The visual counterpart of transcription: reads the picture, not the audio track (for speech use the transcription tools). Pass exactly one source: video_url for a YouTube, Twitter/X, Twitch, Kick or TikTok link, or video_file for a file.
The result is a JSON document: {"events": [{"start", "end", "description", ...}], "scenes": [...], "meta": {"duration", "preset", ...}}, with start/end in seconds. Priced on machine time, so longer videos and higher presets cost more; quote first with video_description_price. A long video can take several minutes: if the tool times out, follow up with check_job_status.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"model": "<model>"
},
"name": "video_description"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | Video description model (e.g., 'Marlin_2B') | |
| preset | No | Detail level: 'fast', 'balanced' or 'detail'. Higher presets read small on-screen text and logos but cost more (roughly x1 / x1.7 / x3.75 machine time). Unset: 'balanced', or the cheapest preset the model offers. Ignored by models without presets | |
| video_url | No | Link to a video on YouTube, Twitter/X, Twitch, Kick or TikTok; the API fetches it itself. Not for a direct link to a video file: pass that as video_file. Live streams and audio-only sources (Twitter Spaces) are rejected | |
| video_file | No | Video file as a direct URL to the file (preferred), data URI (data:video/mp4;base64,...) or base64 string; this server uploads it. Must contain a video stream | |
| webhook_url | No | HTTPS URL for deAPI to call when this job finishes. Notifies your own systems; the tool still returns the result here | |
| webhook_secret | No | 32-255 char key deAPI signs the callback with (HMAC-SHA256). Needs webhook_url. A secret given in chat stays in the transcript | |
| include_metadata | No | Return the source's title, channel, upload date and view/like counts. URL sources only; carries a flat surcharge | |
| return_result_in_response | No | Return the description JSON inline in 'result'. Set to False for long videos to get only the download URL |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||