video_translation_dubbing
Translate video speech into different languages using AI-generated voices. Extract audio, translate content, and generate dubbed versions for multilingual video accessibility.
Instructions
[AllVoiceLab Tool] Translate and dub video speech into a different language with AI-generated voices.
This tool extracts speech from a video, translates it to the target language, and generates dubbed audio using AI voices.
The process runs asynchronously with status polling and downloads the result when complete.
Args:
video_file_path: Path to the video or audio file to process. Supports MP4, MOV, MP3, and WAV formats. Maximum file size: 2GB.
target_lang: Target language code for translation (e.g., 'en', 'zh', 'ja', 'fr', 'de', 'ko'). Required.
source_lang: Source language code of the original content. Set to 'auto' for automatic language detection. Default is 'auto'.
name: Optional project name for identification purposes.
output_dir: Output directory for the downloaded result file. Default is user's desktop.
Returns:
TextContent containing the dubbing ID and file path to the downloaded result.
If the process takes longer than expected, returns only the dubbing ID for later status checking.
Limitations:
- Only MP4, MOV, MP3, and WAV formats are supported
- Maximum file size: 2GB
- Processing may take several minutes depending on content length and complexity
- Translation quality depends on speech clarity in the original content
- Currently supports a limited set of languages for translation
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| video_file_path | Yes | ||
| target_lang | Yes | ||
| source_lang | No | auto | |
| name | No | ||
| output_dir | No |
Input Schema (JSON Schema)
{
"properties": {
"name": {
"default": null,
"title": "Name",
"type": "string"
},
"output_dir": {
"default": null,
"title": "Output Dir",
"type": "string"
},
"source_lang": {
"default": "auto",
"title": "Source Lang",
"type": "string"
},
"target_lang": {
"title": "Target Lang",
"type": "string"
},
"video_file_path": {
"title": "Video File Path",
"type": "string"
}
},
"required": [
"video_file_path",
"target_lang"
],
"type": "object"
}