chat_with_audio
Transcribe and chat with audio files using AI. Provide an audio file name and optional prompts to get a response based on the audio content.
Instructions
A tool used to chat with audio files. The response will be a response to the audio file sent. It is recommended to use gpt-4o-audio-preview by default for best results. Note: gpt-4o-mini-audio-preview has limitations with audio chat and may not process audio correctly.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"input_file_name": "<input_file_name>"
},
"name": "chat_with_audio"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| input_file_name | Yes | ||
| model | No | gpt-4o-audio-preview | |
| system_prompt | No | ||
| user_prompt | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | The response text from the audio chat |