analyze_image
Analyze images to generate structured JSON, enabling coding agents to interpret screenshots, UI mockups, and documents for automated tasks.
Instructions
Analyze a general image and return structured JSON for a coding agent.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| task | No | Optional analysis task. | |
| file_id | No | file_id returned by PUT /upload. Preferred over image_base64 to avoid corruption of large base64 in the tool-call path. Persistent across restarts, content-deduplicated. | |
| mime_type | No | MIME type. Required with image_base64; ignored (uses stored value) with file_id. | image/png |
| image_base64 | No | Raw base64-encoded image bytes, without a data: URL prefix. Prefer file_id for large images. | |
| output_format | No | json |