Skip to main content
Glama

Generate a video

generate_video

Generate a video from a prompt, animate an existing image asset with referenceAssetId, or put the people, products and places of up to 5 pictures into a new shot with references (load builtin-generative-video first). Duration is 4–15 seconds. The video comes with its own sound (generateAudio null or true) unless generateAudio is false. Standard settings: 5 seconds, 16:9, 720p, standard quality, with sound. quality picks how it is made: standard (null) for B-roll and most shots; high for a hero shot, made 5 to 15 seconds long and always with its own sound; highest only when the person asks for the best quality. A video with references is made at high, whatever quality you pick. A request a quality cannot make, such as a silent video at high, runs at the next quality up and is charged at it. It answers at once with a Job ID and the media is made in the background: start every generation you need, keep working, then call wait_for_jobs with all their Job IDs to get each Asset ID for patch_film. Uses credits for each second: standard about 11 credits a second at 720p and about 7.6 credits a second at 480p; high about 23 credits a second at 720p and about 19 credits a second at 480p; highest about 80 credits a second at 720p and about 36 credits a second at 480p. So a 5-second 720p video uses 57 credits at standard, 114 at high and 399 at highest. Tell the person this estimate for the quality and length you picked before you generate. A credit refusal says what the video needs and how many credits are left: retry only with a duration, resolution or quality that fits, and never substitute another media kind.

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
promptYesUp to 2000 characters.
qualityYesstandard (null) for B-roll and most shots, high for a hero shot, highest only when the person asks for the best quality.
projectIdYesThe project this call runs on without changing the open project. null (or leaving it out) uses the open project. wait_for_jobs takes the projectId of the calls that started the jobs.
referencesYesUp to 5 pictures of the people, products, places or look to keep in the video, in this order, or null for none. Each one is: asset:ID, an image asset; asset:ID#t=14.6, the frame of a video asset at 14.6 seconds; film:#t=3.2, the frame of the edit at 3.2 seconds. In the prompt call them Image 1 to Image 5 by their order: "Image 1 is the woman, Image 2 is her sneaker. She laces up the sneaker on a rooftop at sunset." Not with referenceAssetId: to open on a picture, put it here and say so in the prompt.
resolutionYes
aspectRatioYes
generateAudioYesWhether the video has its own sound, made with the picture: dialogue, sound effects, ambience and music that match what happens. null or true (the default) makes sound. false makes the video silent: only when the person asks for a silent video. To keep a clip quiet under narration or music, keep its sound and set the clip's volume in the film instead: a silent video cannot get sound back.
durationSecondsYes
referenceAssetIdYesImage asset id from search_assets to animate into the video, or null to generate from the prompt alone.

Schema Changelog

Changes observed during successful MCP inspections.

  1. First observed

TDQS

A4.9/5.0
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Annotations only mark it as a non-idempotent, open-world write; the description adds the operationally critical behaviors: it is asynchronous (returns a Job ID, media produced in background), credits are consumed per second at quality/resolution-dependent rates, impossible quality/silence combinations are silently upgraded and charged at the higher tier, and silent video is irreversible. That is far beyond what annotations convey.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Front-loaded with the three modes and dense with useful rules, but the credit costs are restated three times (per-second rates, then worked examples), and the quality guidance duplicates the schema's own quality description. Slightly long, though nearly every sentence earns its place.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a 9-parameter async generation tool with no output schema, the description supplies the missing return handoff (Job ID, then wait_for_jobs -> Asset ID for patch_film), cost estimation duties, failure handling, and mode selection. An agent has everything needed to invoke and follow up correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters5/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

With 67% schema coverage, the description meaningfully compensates: it explains quality tier semantics and auto-upgrade behavior, generateAudio's null/true/false meaning plus the irreversibility caveat, the references string formats and ordering rules, and the standard defaults for duration, aspect ratio, resolution and audio. Resolution, duration and aspectRatio are left to their schema enums/bounds, which is adequate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The first sentence states a specific verb and resource and enumerates the three distinct generation modes (from prompt, animate an image via referenceAssetId, and compose from up to 5 references). It clearly distinguishes itself from siblings like generate_image and generate_music by naming the medium and its inputs.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines5/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives explicit when-to-use rules: the load builtin-generative-video prerequisite, quality selection guidance (standard for B-roll, high for hero shots, highest only on request), when to use references vs referenceAssetId, and when generateAudio may be false. It also prescribes the downstream workflow (wait_for_jobs then patch_film) and the retry policy after a credit refusal.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Try in Browser

Glama MCP Gateway

Add one secure layer between your agents and this server.