generate_sound
PRE-FETCH (mandatory for the video models): resources/read kubeez://skills/media-upload AND kubeez://skills/billing-confirmation. Every model here bills PER SECOND and Kubeez has no refunds — quote with estimate before you fire.
Scope: generate:media. Sound effects and music, either from a sentence or written against a clip you already have. NOT for songs with vocals — that is generate_music (Suno).
PICK BY WHAT YOU HAVE:
You have a sentence:
sonilo-text-to-sfx one described sound effect. 1-180s, default 5s. 3s billing floor.
sonilo-text-to-music an instrumental track. 5-360s, default 60s. 10s billing floor.
You have a clip (video_url REQUIRED, https, up to 360s):
sonilo-video-to-sfx effects matched to the picture, as a bare audio track
sonilo-video-to-music a score written to the cut, as a bare audio track
sonilo-video-to-sound both, mixed, as a bare audio track
sonilo-video-to-video-sfx same as above but returns the CLIP with the sound in it
sonilo-video-to-video-music same, muxed
sonilo-video-to-video-sound same, muxed
Prefer a -video-to-video-* id when the user wants a finished clip back; prefer the bare audio ids when they will mix it themselves in an editor.
PROMPTS: pass prompt and it is folded into the field that model reads. The two *-sound models write effects AND music, so they take music_prompt and sfx_prompt separately and reject a lone prompt. Max 2000 chars each. A video run with no prompt at all is valid — the model writes to what it sees.
BILLING: per second of the CLIP, not of the output, and each product carries the provider's OWN minimum billable length: 10s on anything that writes MUSIC (both mixed *-sound ids included), 3s on the effects-only ids. A 6s score bills 10s; a 2s effect bills 3s. estimate(model=..., reference_video_seconds=) applies it.
CLIP LENGTH: a video run bills the clip's length as the SERVER measures it, so the clip must be a Kubeez upload (get_upload_url) or one of your own Kubeez generations; any other URL is refused. duration_seconds does not change the bill on a video run.
LOCAL FILE: get_upload_url(model_id='sonilo-video-to-video-sfx') → upload → get_upload_session(token) → pass the returned URL as video_url. Its media[].duration_seconds is the measured length, for an exact estimate.
ASYNC: returns {generation_id, status:'pending'}. Poll get_status(generation_id). Sonilo has NO provider callback, so the poll is also what settles the run — keep polling until the status is completed or failed, or the credits stay reserved.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"model": "<model>"
},
"name": "generate_sound"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | ||
| prompt | No | ||
| ducking | No | ||
| video_url | No | ||
| sfx_prompt | No | ||
| music_prompt | No | ||
| preserve_speech | No | ||
| duration_seconds | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||