Skip to main content
Glama

Generate Sequencer audio

generate_audio
Destructive

Generate AI audio through Sequencer, including speech, music, and sound effects. For Sonilo Video to Music or Video Sound Effects, provide sourceVideoMediaId or sourceVideoUrl and use the source clip duration when quoting. If no speech model is specified, Sequencer uses Cartesia Sonic 3.6 (cartesia-sonic-3-6). An active skill's explicit model still takes priority. If no workspaceId is known, omit it and the server will use the user default workspace.

Tool call template

This tool declares no required parameters. Add optional parameters from the input schema as needed.

{
  "id": 1,
  "jsonrpc": "2.0",
  "method": "tools/call",
  "params": {
    "arguments": {},
    "name": "generate_audio"
  }
}

Input Schema

NameRequiredDescriptionDefault
modelNoModel ID, for example cartesia-sonic-3-6 for Cartesia Sonic 3.6, elevenlabs-tts-v3 for speech, lyria-002 for music, or another ID returned by get_model_catalog. Uses cartesia-sonic-3-6 if not specified.
promptNoText to speak or creative direction. Optional for Sonilo video-conditioned audio.
voiceIdNoVoice ID for TTS models
maxCostUsdNoMaximum charge for each output. Checked against authoritative pricing before generation.
sparkTaskIdNoOriginating Spark task for library history and recovery.
stylePromptNoDelivery and accent direction for supported speech models, for example: warm Argentine Spanish with natural Rioplatense pronunciation.
workspaceIdNoOptional workspace ID. If omitted, Sequencer uses the user default/personal workspace.
modelSettingsNoModel-specific controls using keys and options from get_model_catalog inputConstraints.slots or variantSelector.
idempotencyKeyNoStable request key. Retries with the same key reuse the existing output and do not start another paid generation.
sourceDurationNoAudio duration in seconds. For video-conditioned audio, use the source clip length when quoting.
sourceVideoUrlNoPublic HTTP(S) source-video URL.
sourceVideoMediaIdNoWorkspace video to edit or transform, when supported by the selected model.

Output Schema

NameRequiredDescriptionDefault
dataNo
errorNo
successYes

Schema Changelog

Changes observed during successful MCP inspections.

  1. Changed6 schema fields changed
    • addedInput schema / properties / prompt / default
      Added value: +""
    • changedInput schema / properties / prompt / description
      Previous value: -"Text to speak (for TTS) or music prompt"New value: +"Text to speak or creative direction. Optional for Sonilo video-conditioned audio."
    • changedInput schema / properties / sourceDuration / description
      Previous value: -"Source audio duration in seconds. Match the approved quote."New value: +"Audio duration in seconds. For video-conditioned audio, use the source clip length when quoting."
    • addedInput schema / properties / sourceVideoMediaId
      Added value: +{
      +  "description": "Workspace video to edit or transform, when supported by the selected model.",
      +  "type": "string"
      +}
    • addedInput schema / properties / sourceVideoUrl
      Added value: +{
      +  "description": "Public HTTP(S) source-video URL.",
      +  "format": "uri",
      +  "type": "string"
      +}
    • removedInput schema / required
      Removed value: -[
      -  "prompt"
      -]
  2. Changed1 schema field changed
    • changedInput schema / properties / model / description
      Previous value: -"Model ID, for example elevenlabs-tts-v4 for ElevenLabs V4 Speech, elevenlabs-tts-v3 for speech, lyria-002 for music, or another ID returned by get_model_catalog. Uses elevenlabs-tts-v4 if not specified."New value: +"Model ID, for example cartesia-sonic-3-6 for Cartesia Sonic 3.6, elevenlabs-tts-v3 for speech, lyria-002 for music, or another ID returned by get_model_catalog. Uses cartesia-sonic-3-6 if not specified."
  3. Changed2 schema fields changed
    • addedInput schema / properties / modelSettings
      Added value: +{
      +  "additionalProperties": {
      +    "anyOf": [
      +      {
      +        "type": "string"
      +      },
      +      {
      +        "type": "number"
      +      },
      +      {
      +        "type": "boolean"
      +      }
      +    ]
      +  },
      +  "description": "Model-specific controls using keys and options from get_model_catalog inputConstraints.slots or variantSelector.",
      +  "type": "object"
      +}
    • addedInput schema / properties / sourceDuration
      Added value: +{
      +  "description": "Source audio duration in seconds. Match the approved quote.",
      +  "exclusiveMinimum": 0,
      +  "maximum": 3600,
      +  "type": "number"
      +}
  4. Changed1 schema field changed
    • changedOutput schema / properties / data / anyOf
      Previous value: -[
      -  {
      -    "additionalProperties": false,
      -    "properties": {
      -      "aspectRatio": {
      -        "type": [
      -          "string",
      -          "null"
      -        ]
      -      },
      -      "downloadUrl": {
      -        "anyOf": [
      -          {
      -            "format": "uri",
      -            "type": "string"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "durationMs": {
      -        "type": [
      -          "number",
      -          "null"
      -        ]
      -      },
      -      "error": {
      -        "type": [
      -          "string",
      -          "null"
      -        ]
      -      },
      -      "imageUrl": {
      -        "anyOf": [
      -          {
      -            "format": "uri",
      -            "type": "string"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "mediaId": {
      -        "type": "string"
      -      },
      -      "model": {
      -        "type": [
      -          "string",
      -          "null"
      -        ]
      -      },
      -      "playableUrl": {
      -        "anyOf": [
      -          {
      -            "format": "uri",
      -            "type": "string"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "posterUrl": {
      -        "anyOf": [
      -          {
      -            "format": "uri",
      -            "type": "string"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "progress": {
      -        "anyOf": [
      -          {
      -            "maximum": 1,
      -            "minimum": 0,
      -            "type": "number"
      -          },
      -          {
      -            "type": "null"
      -          }
      -        ]
      -      },
      -      "progressLabel": {
      -        "type": [
      -          "string",
      -          "null"
      -        ]
      -      },
      -      "prompt": {
      -        "type": [
      -          "string",
      -          "null"
      -        ]
      -      },
      -      "status": {
      -        "enum": [
      -          "queued",
      -          "generating",
      -          "completed",
      -          "failed"
      -        ],
      -        "type": "string"
      -      },
      -      "type": {
      -        "enum": [
      -          "image",
      -          "video",
      -          "audio"
      -        ],
      -        "type": "string"
      -      },
      -      "viewUrl": {
      -        "format": "uri",
      -        "type": "string"
      -      },
      -      "workspaceId": {
      -        "type": "string"
      -      }
      -    },
      -    "required": [
      -      "workspaceId",
      -      "mediaId",
      -      "type",
      -      "status",
      -      "progress",
      -      "progressLabel",
      -      "playableUrl",
      -      "imageUrl",
      -      "posterUrl",
      -      "downloadUrl",
      -      "viewUrl",
      -      "durationMs",
      -      "model",
      -      "aspectRatio",
      -      "prompt",
      -      "error"
      -    ],
      -    "type": "object"
      -  },
      -  {
      -    "additionalProperties": false,
      -    "properties": {
      -      "activeIndex": {
      -        "minimum": 0,
      -        "type": "integer"
      -      },
      -      "items": {
      -        "items": {
      -          "$ref": "#/properties/data/anyOf/0"
      -        },
      -        "maxItems": 8,
      -        "minItems": 1,
      -        "type": "array"
      -      }
      -    },
      -    "required": [
      -      "items",
      -      "activeIndex"
      -    ],
      -    "type": "object"
      -  }
      -]New value: +[
      +  {
      +    "additionalProperties": false,
      +    "properties": {
      +      "aspectRatio": {
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "downloadUrl": {
      +        "anyOf": [
      +          {
      +            "format": "uri",
      +            "type": "string"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "durationMs": {
      +        "type": [
      +          "number",
      +          "null"
      +        ]
      +      },
      +      "elapsedSeconds": {
      +        "anyOf": [
      +          {
      +            "minimum": 0,
      +            "type": "number"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "error": {
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "heartbeatAgeSeconds": {
      +        "anyOf": [
      +          {
      +            "minimum": 0,
      +            "type": "number"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "height": {
      +        "anyOf": [
      +          {
      +            "exclusiveMinimum": 0,
      +            "type": "number"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "imageUrl": {
      +        "anyOf": [
      +          {
      +            "format": "uri",
      +            "type": "string"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "lastHeartbeatAt": {
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "mediaId": {
      +        "type": "string"
      +      },
      +      "model": {
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "playableUrl": {
      +        "anyOf": [
      +          {
      +            "format": "uri",
      +            "type": "string"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "posterUrl": {
      +        "anyOf": [
      +          {
      +            "format": "uri",
      +            "type": "string"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "progress": {
      +        "anyOf": [
      +          {
      +            "maximum": 1,
      +            "minimum": 0,
      +            "type": "number"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "progressLabel": {
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "prompt": {
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "requestedAspectRatio": {
      +        "type": [
      +          "string",
      +          "null"
      +        ]
      +      },
      +      "status": {
      +        "enum": [
      +          "queued",
      +          "generating",
      +          "completed",
      +          "failed"
      +        ],
      +        "type": "string"
      +      },
      +      "type": {
      +        "enum": [
      +          "image",
      +          "video",
      +          "audio"
      +        ],
      +        "type": "string"
      +      },
      +      "viewUrl": {
      +        "format": "uri",
      +        "type": "string"
      +      },
      +      "width": {
      +        "anyOf": [
      +          {
      +            "exclusiveMinimum": 0,
      +            "type": "number"
      +          },
      +          {
      +            "type": "null"
      +          }
      +        ]
      +      },
      +      "workspaceId": {
      +        "type": "string"
      +      }
      +    },
      +    "required": [
      +      "workspaceId",
      +      "mediaId",
      +      "type",
      +      "status",
      +      "progress",
      +      "progressLabel",
      +      "playableUrl",
      +      "imageUrl",
      +      "posterUrl",
      +      "downloadUrl",
      +      "viewUrl",
      +      "durationMs",
      +      "model",
      +      "aspectRatio",
      +      "prompt",
      +      "error"
      +    ],
      +    "type": "object"
      +  },
      +  {
      +    "additionalProperties": false,
      +    "properties": {
      +      "activeIndex": {
      +        "minimum": 0,
      +        "type": "integer"
      +      },
      +      "items": {
      +        "items": {
      +          "$ref": "#/properties/data/anyOf/0"
      +        },
      +        "maxItems": 8,
      +        "minItems": 1,
      +        "type": "array"
      +      }
      +    },
      +    "required": [
      +      "items",
      +      "activeIndex"
      +    ],
      +    "type": "object"
      +  }
      +]
  5. Changed1 schema field changed
    • changedInput schema / properties / model / description
      Previous value: -"Model ID, for example cartesia-sonic-3-5 for Cartesia Sonic 3.5, elevenlabs-tts-v3 for speech, lyria-002 for music, or another ID returned by get_model_catalog. Uses cartesia-sonic-3-5 if not specified."New value: +"Model ID, for example elevenlabs-tts-v4 for ElevenLabs V4 Speech, elevenlabs-tts-v3 for speech, lyria-002 for music, or another ID returned by get_model_catalog. Uses elevenlabs-tts-v4 if not specified."
  6. First observed

TDQS

A4/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations already declare destructiveHint=true, openWorldHint=true and idempotentHint=false, so the safety profile is covered. The description adds non-obvious behavior beyond them: the model resolution precedence (an active skill's explicit model overrides the specified one, otherwise Cartesia Sonic 3.6), the workspace fallback, and the norm of quoting against source clip duration. It does not restate that generation is paid/irreversible, though maxCostUsd is documented in the schema.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Four sentences, front-loaded with the core purpose, then the video-conditioned case, then default resolution, then the workspace fallback. No filler and no redundancy with the title.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With 12 parameters, an output schema, and full annotation coverage, the description supplies the decision-critical defaults and the video-conditioning path an agent needs to call correctly. Cost/quoting caveats and the destructive nature of the call are left to annotations and schema, which is acceptable but keeps it just short of complete.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema description coverage is 100%, so parameters like model, workspaceId, and idempotencyKey are already fully documented in the schema. The description reinforces the model default and the source-video parameters and ties sourceDuration to quoting, but adds no syntax or format detail beyond what the schema provides. Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description states a specific verb and resource ('Generate AI audio through Sequencer') and enumerates the modalities covered: speech, music, and sound effects. It does not name or contrast with close siblings such as generate_audio_track or generate_video_audio, so an agent must infer the boundary from the parameter hints rather than explicit routing.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

It gives clear conditional guidance: for Sonilo Video to Music or Video Sound Effects, supply sourceVideoMediaId or sourceVideoUrl and quote using the source clip duration. It also resolves two practical decision points (omit workspaceId to use the default; omit model to get Cartesia Sonic 3.6). What is missing is explicit routing against the sibling audio-generation tools.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.