Analyze an image with a vision model
vision_analyzeAnalyze images using a vision model to explain screenshots, UI, diagrams, charts, or error messages that need reasoning. Not for text extraction.
Instructions
Understand, explain, or describe an image using a vision model. Use for interpreting screenshots, UI, diagrams, charts, or error messages that need reasoning. Not for verbatim text extraction (use vision_ocr).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | Optional model override. | |
| detail | No | Optional detail level for providers that support it. | |
| prompt | Yes | Instruction passed to the vision model. | |
| imageUrl | No | Remote URL, data URL, or file URL. Mutually exclusive with imagePath and imageBase64. | |
| imagePath | No | Local absolute image path. Mutually exclusive with imageUrl and imageBase64. | |
| maxTokens | No | Optional max output tokens. | |
| imageBase64 | No | Base64-encoded image payload. Use this for uploaded attachments when the client can pass file contents. | |
| imageMediaType | No | Required with imageBase64, for example image/png or image/jpeg. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | Text returned by the vision model. | |
| model | Yes | Model used for the request. | |
| mediaType | Yes | Resolved image media type. | |
| sourceLabel | Yes | Resolved image source label. |