h3_reference_to_video
Generate video with synchronized audio using reference images, videos, or audio to maintain consistent characters and locations across shots.
Instructions
Generate video with synchronized audio from a prompt plus reference images, videos, and/or audio (MiniMax-H3 ref2va model).
References are addressed positionally in the prompt as , and , all 1-based per type - e.g. "<Picture 1> walks through the door speaking in the voice of <Audio 1>". Max 9 images, 3 videos, 3 audio. A reference video's own soundtrack is passed through automatically. ref_image_size "match" scales references to the output's pixel area; "max" uses a 2048px short edge for better identity fidelity but is several times slower, since reference tokens ride through every step. This is the tool for CONSISTENCY ACROSS SHOTS: generate shot 1, pull a frame of the character or location from it, and pass it here as a reference for shots 2..n so they match. Leave width/height unset (864x480 default). Takes MINUTES; see estimated_seconds in the response and poll at that cadence. Check list_assets before setting sage_attention - it is redundant when ComfyUI already runs with --use-sage-attention. Returns immediately with a prompt_id - poll job_status to get the output.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| seed | No | ||
| steps | No | ||
| width | No | ||
| height | No | ||
| length | No | ||
| prompt | Yes | ||
| scheduler | No | simple | |
| megapixels | No | ||
| ref_audios | No | ||
| ref_images | No | ||
| ref_videos | No | ||
| shift_audio | No | ||
| shift_video | No | ||
| sampler_name | No | res_multistep | |
| ref_image_size | No | match | |
| sage_attention | No | disabled | |
| filename_prefix | No | video/h3_ref2v |