lipsync_video
Re-sync lips in an existing talking video to new spoken words. Dub a short clip by providing text for TTS or an audio track to match.
Instructions
Re-sync the lips in an existing talking VIDEO to NEW speech — video dubbing / re-voicing (powered by fal-ai/sync-lipsync). ASYNC — returns a job_id; the caller MUST poll check_job until status="completed" (usually 1-3 min). Returns a hosted MP4 URL on completion. TWO INPUT MODES: (A) provide text = the NEW words to say, and the server voices them with ElevenLabs TTS (auto-detects language incl. Russian; pick a voice preset) then lip-syncs; OR (B) provide audio_url = a ready voice/audio track to sync to (then text/voice are ignored). Exactly one of text or audio_url is required, plus video_url. The source clip must be a short talking-head video (front-facing face, max 20 seconds — longer clips are rejected; trim first). Use for "make this video say X", "dub this clip", "re-voice this video", "change what the person says". This is DIFFERENT from generate_talking_avatar (which makes a NEW talking face from a still portrait); lipsync_video edits an EXISTING video. TWO-STEP FLOW (confirmation REQUIRED — this reserves tokens): STEP 1 (preview) call WITHOUT confirmed → returns the estimated cost (TTS + lip-sync), submits nothing, reserves nothing. STEP 2 (submit) call again with confirmed=true → submits the job and reserves tokens. Cost typically 300-600 tokens.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | No | Mode A: the NEW words the person should say (any language, read verbatim — no stage directions). Up to ~500 chars. Either this OR audio_url is required. | |
| voice | No | Mode A only: TTS voice preset — Aria, Sarah, Charlotte, Matilda (female) or Roger, George, Charlie, Brian (male). Default Aria. Ignored when audio_url is given. | |
| audio_url | No | Mode B: URL of a ready audio/voice track to lip-sync the video to (external https:// or avots /v1/files/<uuid>). When given, text/voice are ignored. | |
| confirmed | No | Must be true to actually submit + reserve tokens. Omit/false for a cost-only preview. | |
| video_url | Yes | URL of the talking-head video to re-sync (max 20s, clear front-facing face). Accepts an external https:// URL or an avots-hosted /v1/files/<uuid> URL. |