Skip to main content
Glama

kling_lip_sync

Replace a video's lip movements with audio-driven or text-to-speech speech for dubbing or talking-head videos.

Instructions

Synchronize lip movements in a video to match a given audio track or text.

Takes an existing video (by URL or task ID) and replaces the speaker's lip
movements so they match the provided audio. In 'text2video' mode the audio
is generated from the supplied text via TTS.

Use this when:
- You want to dub a video into a different language
- You want to replace the audio of a generated video with custom speech
- You want to create a talking-head video from text

Returns:
    Task ID and lip-sync video information.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
modeYesLip-sync mode. 'audio2video' to drive lips from an audio file or URL; 'text2video' to generate speech from text and drive the video.
textNoText to convert to speech. Required when mode='text2video'.
video_idNoTask ID of a previously generated video to use as the source. Provide either video_url or video_id.
voice_idNoVoice ID to use for text-to-speech synthesis (mode='text2video').
audio_urlNoURL of the driving audio. Required when mode='audio2video' and audio_type='url'.
video_urlNoURL of the source video whose lip movements will be replaced. Provide either video_url or video_id.
audio_fileNoBase64-encoded audio file content. Required when mode='audio2video' and audio_type='file'.
audio_typeNoAudio source type. 'url' (default) to supply audio_url; 'file' to supply audio_file as a base64-encoded string.url
voice_speedNoSpeech speed multiplier (default 1.0). Used when mode='text2video'.
callback_urlNoWebhook URL that receives a POST when the lip-sync task completes.
voice_languageNoLanguage of the TTS voice. 'zh' for Chinese (default), 'en' for English. Used when mode='text2video'.zh

Output Schema

TableJSON Schema
NameRequiredDescriptionDefault
resultYes
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description carries the behavioral burden. It transparently explains the transformation ('replaces the speaker's lip movements'), the mode behavior (text2video generates audio via TTS), and the return shape (Task ID and lip-sync video information). It does not explicitly describe async behavior or error conditions, but the return of a Task ID implies polling/callback, and the callback_url parameter is present in the schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is compact and front-loaded with the core action, followed by a brief explanation, a 'Use this when' bulleted list, and a Returns line. Every sentence adds value and there is no fluff or redundancy.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a tool with 11 parameters and an output schema, the description covers the essential context: purpose, input types (URL, task ID, audio, text), modes, use cases, and return. It omits explicit async execution notes and prerequisites (e.g., video must contain a face), but given the schema richness and output schema, this is adequate and above minimal viability.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, with every parameter having a description. The description adds only high-level context (e.g., 'takes an existing video by URL or task ID') that maps directly to video_url/video_id and audio_url/audio_file. It does not add meaning beyond the schema's parameter descriptions, earning the baseline of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description opens with a specific verb and resource: 'Synchronize lip movements in a video to match a given audio track or text.' It clearly distinguishes the tool from siblings like kling_generate_video and kling_talking_photo by explaining it replaces lips in an existing video. The two modes (audio2video and text2video) are explicitly described.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The 'Use this when' section explicitly lists three concrete scenarios (dubbing, replacing audio, talking-head from text), providing clear context for when to use the tool. However, it does not mention when not to use it or name alternative sibling tools, so it stops short of a full 5.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/AceDataCloud/KlingMCP'

If you have feedback or need assistance with the MCP directory API, please join our Discord server