Understand
understandAnalyze images and videos from multiple URLs using a custom prompt. Gemini handles mixed media in one call, while OpenAI and Grok process images only.
Instructions
Understand images and/or videos (multi-URL) with a prompt. Gemini supports mixed image+video in one call; OpenAI/Grok are image-only.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"media_urls": "<media_urls>",
"prompt": "<prompt>"
},
"name": "understand"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| tier | No | poor | |
| model | No | ||
| prompt | Yes | ||
| provider | No | ||
| max_tokens | No | ||
| media_urls | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||