Input: A muted video URL along with a textual prompt describing the desired audio.
Output: We will return the video URL with the applied audio.
Functionality: This tool now takes a muted video and a text prompt as input. It generates an audio track based on the provided prompt and applies this audio to the video, resulting in a video with integrated sound.
Steps:
1. We will get the user_id from the request context.
2. We will validate the user's generation tokens.
3. We will call the Audio Application API with the muted video URL and the provided prompt.
4. The API will generate the audio from the prompt and merge it with the muted video, returning a JSON response with the updated video URL.
5. We will return the updated video URL to the user.
INSTRUCTION FOR CLIENT MODEL:
- Extract the required input parameters 'video_url' (type: string, URL) and 'prompt' (type: string, describing the desired audio) from the user's prompt.
- Ignore any extraneous information in the user's input.
- Pass the extracted values to this tool as 'video_url' and 'prompt'.
- Example: For user input "Add dramatic orchestral music to this video https://example.com/video.mp4", extract 'video_url' as 'https://example.com/video.mp4' and 'prompt' as 'dramatic orchestral music'.
Connector
