refer_images
Answer questions about specific image uploads by referencing their labels, grounding each answer in the cited figures.
Instructions
Answer a question that refers to specific uploads by label ("refer image 1 and 2", "only the second screenshot", "both figures"). Grounds every claim in image labels.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| image | No | Local file path, file:// URI, http(s) URL, data URL, or base64 image data | |
| images | Yes | One or more images. Prefer this for multi-image chats: ["path/a.png", "path/b.png"] or [{source, label: "1"}, {source, label: "2"}]. Labels default to "1", "2", ... | |
| prompt | Yes | User question with image references, e.g. "Using image 1 and image 2, which button is primary?" | |
| mimeType | No | Optional MIME type hint for a single bare-base64 `image` input, e.g. image/png |