Image To Video
image_to_videoGenerate video from a static image or reference images, videos, and audio using text prompts.
Instructions
Generate video from static image(s), or from reference images, videos and audio.
Two modes, mutually exclusive:
Keyframes: first_frame_image (and optionally last_frame_image) is animated.
References: ref_images / ref_videos / ref_audios, on models that support them (the model list shows "refs: ..." for those). The prompt addresses each reference by its tag: <Picture 1>, <Picture 2> for images, <Video 1> for a video, <Audio 1> for audio, numbered from 1 within each type in the order given. Order matters: swapping two images swaps what the tags refer to. Example prompt: "<Picture 1> walks into the room from <Picture 2>, speaking with the voice of <Audio 1>".
Accepts files as:
Public URLs (recommended: chains with text_to_image, and the ONLY way in for a file of your own - chat clients do not pass files through to tools)
Data URIs or raw base64 (for callers that already hold the bytes)
IMPORTANT: Check model specifications using get_available_models() before calling. Pay attention to limits for width/height/frames/fps and, in reference mode, the max_ref_* counts and durations.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"prompt": "<prompt>",
"model": "<model>"
},
"name": "image_to_video"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| fps | No | Frames per second. Defaults to the model's own value (see the model list); most models fix it | |
| seed | No | Random seed for reproducibility | |
| model | Yes | Video generation model name | |
| steps | No | Number of inference steps. Defaults to the model's own value (see the model list); ignored by models that do not support steps | |
| width | No | Video width in pixels. Defaults to the model's own value (see the model list) | |
| frames | No | Number of video frames. Defaults to the model's own value (see the model list); each model has its own range | |
| height | No | Video height in pixels. Defaults to the model's own value (see the model list) | |
| prompt | Yes | Text prompt for video generation | |
| ref_audios | No | Reference audio clips (URL, data URI or base64), in order: ref_audios[0] is <Audio 1> (or <Audio 2> after a sounded reference video). Needs at least one ref_images or ref_videos entry | |
| ref_images | No | Reference images (URL, data URI or base64), in order: ref_images[0] is <Picture 1> in the prompt, ref_images[1] is <Picture 2>, and so on. Each within a 1:4-4:1 aspect ratio. Only for models listing image refs in the model list; replaces first_frame_image | |
| ref_videos | No | Reference videos (URL, data URI or base64), in order: ref_videos[0] is <Video 1>. Usually at most one, a few seconds long (see the model list). A video with a soundtrack takes <Audio 1> and shifts every ref_audios label by one | |
| webhook_url | No | HTTPS URL for deAPI to call when this job finishes. Notifies your own systems; the tool still returns the result here | |
| enhance_prompt | No | Let the API rewrite the prompt before generating. Only on models with a prompt-booster guide (422 otherwise); its fee is charged on the job and is not in the /price quote | |
| guidance_scale | No | Guidance scale. Leave unset to use the model's own default; no model in the catalogue currently supports guidance | |
| webhook_secret | No | 32-255 char key deAPI signs the callback with (HMAC-SHA256). Needs webhook_url. A secret given in chat stays in the transcript | |
| negative_prompt | No | Things to exclude (optional) | |
| last_frame_image | No | Last frame image (optional, URL, data URI, or base64). Not allowed with reference inputs | |
| first_frame_image | No | First frame image as URL (e.g., from text_to_image result), data URI (data:image/png;base64,...), or base64 string. URLs are recommended when chaining from text_to_image to avoid base64 context bloat. Required unless ref_images or ref_videos are given; the two modes are mutually exclusive |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||