Studio: generate video
studio_generate_videoGenerate a single video clip via the Studio model catalog (call list_studio_models for keys). ASYNC — returns a jobId; poll get_job until status is succeeded/failed. SPENDS CREDITS. firstFrame/lastFrame/referenceImages/referenceVideos/referenceAudios accept URLs (import them first if needed). Video-edit models (capabilities.supportsReferenceVideos, e.g. fal-gemini-omni-flash-edit) take the source clip as referenceVideos[0] — never as a reference image. Models with capabilities.maxElements (fal-kling-4) keep characters and objects consistent: pass elements [{frontalImage, views[1–3], voiceSample?}] and name them @Element1, @Element2 … in order; an element with a voiceSample (5–30 s of that voice alone) speaks its lines in that voice. Models with capabilities.supportsShots take shots [{prompt ≤512 chars, duration}] instead of one prompt: the clip cuts between them on those seconds and runs for their sum (duration and prompt are then optional). Models with capabilities.videoModes (fal-heygen-video) take videoMode, one of the listed mode ids; without it the model's default mode runs.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "studio_generate_video"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| shots | No | Per-shot prompts (capabilities.supportsShots): each ≤512 characters with whole-second durations; the clip cuts on them and runs for their sum. Each shot prompt stands alone, so repeat the style and the @tags it needs. | |
| prompt | No | The clip's prompt. Optional only when shots are given. | |
| duration | No | ||
| elements | No | Consistent characters/objects (capabilities.maxElements): frontalImage = a front view URL, views = 1–3 more view URLs (a character sheet counts as one), voiceSample = optional URL of 5–30 s of that character's voice alone. Named @Element1 … in array order. | |
| modelKey | No | ||
| lastFrame | No | End-frame image URL (models with capabilities.supportsLastFrame) | |
| videoMode | No | Mode id from the model's capabilities.videoModes (e.g. "quality" on fal-heygen-video). Leave out for models without modes. | |
| firstFrame | No | Start-frame image URL | |
| resolution | No | ||
| aspectRatio | No | ||
| generateAudio | No | ||
| referenceAudios | No | Audio URLs (models with capabilities.supportsReferenceAudio) | |
| referenceImages | No | ||
| referenceVideos | No | Video URLs (models with capabilities.supportsReferenceVideos, up to maxReferenceVideos). For edit models this is the clip to edit. |