describe_image
Describes images for text-only LLM agents by analyzing screenshots, diagrams, logs, and photos with a vision-language model, accepting file paths, URLs, data URIs, or base64 strings.
Instructions
Analyze one or more images with a vision-language model (VLM) and return a text description. USE THIS TOOL when an image cannot be attached directly to the conversation but the model needs to see it: screenshots and screen recordings, error dialogs / crash screens, terminal or log output captured as images, charts, plots and diagrams, UI mockups and designs, photos, memes, or whenever a message references an image file path, http(s) URL, data: URI, or base64 string.Provide the image as: a local file path (relative paths resolve against the server working directory), an http(s) URL, a data: URI, or a raw base64 string. Pass a single string, or an array of strings to describe several images together (the reply contains one section per image).Optional parameters: question for a targeted question (overrides task), task preset (describe | ocr | ui | qa, default describe), detail level (low | high | auto, default high; forwarded only by the OpenAI-compatible provider).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| task | No | Preset task. Ignored when question is provided. | describe |
| image | Yes | Image location(s): a local file path (relative paths resolve against the working directory), an http(s) URL, a data: URI, or a raw base64 string. Pass one string, or an array of strings for multiple images. | |
| detail | No | Image detail level sent to the vision API. Only the OpenAI-compatible provider forwards it. | high |
| question | No | Optional targeted question about the image(s). When provided, overrides task. |