Describe image (UI / web page / layout)
describe_imageAnalyze an image to return a structured description: layout hierarchy, UI components, text, interactions, design notes, and accessibility. Accepts URL, file path, or base64 data.
Instructions
Analyse an image and return a richly structured description — layout hierarchy, UI components, readable text, interactions, design notes, and accessibility observations. Optimised for UI mockups, HTML/CSS screenshots, Figma exports, dashboards, and web/app interfaces. Accepts a public URL, a local file path, or a base64 data URL.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| focus | No | Optional steering for what to emphasise, e.g. "layout only", "extract all text / OCR", "focus on accessibility", "identify design system", "describe the data visualisation". Keeps the description on-task for your current need. | |
| image | Yes | The image to analyse. Accepts three formats: (1) a public URL — e.g. https://example.com/screenshot.png; (2) a local file path — e.g. ~/Desktop/mockup.png or C:\Users\you\shot.png; (3) a base64 data URL — data:image/png;base64,.... Relative paths resolve from the server's working directory. | |
| detail_level | No | How thorough the description should be. standard ≈ 1 paragraph + key elements. detailed ≈ full structured breakdown (default). comprehensive ≈ exhaustive, including edge cases and fine details. | detailed |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | Yes | ||
| tokens | Yes | ||
| summary | Yes | ||
| description | Yes |