Image To Video
image_to_videoGenerate video from static image(s), or from reference images, videos and audio.
Two modes, mutually exclusive:
Keyframes: first_frame_image (and optionally last_frame_image) is animated.
References: ref_images / ref_videos / ref_audios, on models that support them (the model list shows "refs: ..." for those). The prompt addresses each reference by its tag: <Picture 1>, <Picture 2> for images, <Video 1> for a video, <Audio 1> for audio, numbered from 1 within each type in the order given. Order matters: swapping two images swaps what the tags refer to. Example prompt: "<Picture 1> walks into the room from <Picture 2>, speaking with the voice of <Audio 1>".
Accepts files as:
Public URLs (recommended: chains with text_to_image, and the ONLY way in for a file of your own - chat clients do not pass files through to tools)
Data URIs or raw base64 (for callers that already hold the bytes)
IMPORTANT: Check model specifications using get_available_models() before calling. Pay attention to limits for width/height/frames/fps and, in reference mode, the max_ref_* counts and durations.
Available models:
Ltx2_5_22B_Dist_INT8: size=512-1344x512-1344, fps=24 (fixed), frames=49-241, w/h rounded down to a multiple of 64, ≤1.03Mpx, side≤1344, aspect≤2, audio2video audio=1-10s, no negative_promptMiniMaxH3_33B_Turbo_INT8: size=512-1344x512-1344, fps=24 (fixed), frames=56-243, w/h rounded down to a multiple of 32, ≤1.03Mpx, side≤1344, refs: ≤3 images, ≤1 video (0.5-2.3s), ≤3 audio (1-10s), ≤3 files total, no negative_promptLtx2_3_22B_Dist_INT8: size=512-1024x512-1024, fps=24 (fixed), frames=49-241, audio2video audio=1-11s, no negative_promptLtxv_13B_0_9_8_Distilled_FP8: steps=1 (fixed), size=256-768x256-768, fps=30 (fixed), frames=30-120kling-4(test model): size=720-2520x720-1920, fps=24 (fixed), frames=73-721, w/h rounded down to a multiple of 2, ≤2.72Mpx, aspect≤2.34, no negative_promptseedance-2.5(test model): size=432-2206x432-2206, fps=24 (fixed), frames=97-721, w/h rounded down to a multiple of 2, ≤2.09Mpx, side≤2206, aspect≤2.34, refs: ≤9 images, ≤1 video (1.8-30.2s), ≤3 audio (1.8-30.2s), ≤12 files total, no negative_prompt Models marked (test model) are experimental: they may change or disappear. Prefer an unmarked model unless the caller asks for one of them.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>",
"model": "<model>"
},
"name": "image_to_video"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| fps | No | Frames per second. Defaults to the model's own value (see the model list); most models fix it | |
| seed | No | Random seed for reproducibility | |
| model | Yes | Video generation model name | |
| steps | No | Number of inference steps. Defaults to the model's own value (see the model list); ignored by models that do not support steps | |
| width | No | Video width in pixels. Defaults to the model's own value (see the model list) | |
| frames | No | Number of video frames. Defaults to the model's own value (see the model list); each model has its own range | |
| height | No | Video height in pixels. Defaults to the model's own value (see the model list) | |
| prompt | Yes | Text prompt for video generation | |
| ref_audios | No | Reference audio clips (URL, data URI or base64), in order: ref_audios[0] is <Audio 1> (or <Audio 2> after a sounded reference video). Needs at least one ref_images or ref_videos entry | |
| ref_images | No | Reference images (URL, data URI or base64), in order: ref_images[0] is <Picture 1> in the prompt, ref_images[1] is <Picture 2>, and so on. Each within a 1:4-4:1 aspect ratio. Only for models listing image refs in the model list; replaces first_frame_image | |
| ref_videos | No | Reference videos (URL, data URI or base64), in order: ref_videos[0] is <Video 1>. Usually at most one, a few seconds long (see the model list). A video with a soundtrack takes <Audio 1> and shifts every ref_audios label by one | |
| webhook_url | No | HTTPS URL for deAPI to call when this job finishes. Notifies your own systems; the tool still returns the result here | |
| enhance_prompt | No | Let the API rewrite the prompt before generating. Only on models with a prompt-booster guide (422 otherwise); its fee is charged on the job and is not in the /price quote | |
| guidance_scale | No | Guidance scale. Leave unset to use the model's own default; no model in the catalogue currently supports guidance | |
| webhook_secret | No | 32-255 char key deAPI signs the callback with (HMAC-SHA256). Needs webhook_url. A secret given in chat stays in the transcript | |
| negative_prompt | No | Things to exclude (optional) | |
| last_frame_image | No | Last frame image (optional, URL, data URI, or base64). Not allowed with reference inputs | |
| first_frame_image | No | First frame image as URL (e.g., from text_to_image result), data URI (data:image/png;base64,...), or base64 string. URLs are recommended when chaining from text_to_image to avoid base64 context bloat. Required unless ref_images or ref_videos are given; the two modes are mutually exclusive |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||