Gemini Omni Unified Text, Audio & Video Multimodal Analyzer
analyze_omni_multimodal_inputAnalyzes combined multimodal prompts spanning text, image descriptors, audio transcripts, and video temporal events using Gemini Omni Flash. Use when correlating information across multiple media modalities in a single reasoning pass; for running pure text-only reasoning or coding prompts, use generate_gemini_completion instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'input' ('modality_focus' defaults to 'cross_modal_synthesis'), supports '?demo=true' or L402 (100 sats), and returns HTTP 400 if invalid.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| input | Yes | Multimodal prompt or media scene description to analyze. | |
| modality_focus | No | Primary analytical lens applied to the multimodal input; defaults to 'cross_modal_synthesis' when omitted. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | Executed multimodal model ('gemini-omni-flash'). | |
| output | Yes | Unified multimodal analysis and extracted timeline. | |
| success | Yes | True when multimodal processing succeeded. | |
| modalities_processed | Yes | Modalities integrated during inference. |