Analyze Image
analyze_imageAnalyze images with a vision AI model to extract descriptions, text, UI elements, charts, and more. Provide an image via base64 data URL, HTTP link, or local file, and specify what to analyze.
Instructions
Analyze an image with a vision AI model, giving a non-vision main model the ability to "see" image content. Call this when the user sends an image, or when you need to understand an image (describe it, OCR text, identify UI elements, read charts, etc.). The image can be provided as a base64 data URL, an HTTP(S) link, or a local file path.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| image | Yes | The image to analyze. Accepts a base64 data URL (data:image/...), an HTTP/HTTPS link, or a local file path. Formats: JPEG, PNG, WebP, GIF, BMP. | |
| prompt | Yes | What you want analyzed or extracted from the image, e.g. 'Describe this image in detail' or 'Extract all visible text (OCR)'. |