look
Inspect any window, taskbar, desktop, or screen without bringing it to the foreground. Get numbered UI elements, text, or an image to locate, read, and verify controls before acting.
Instructions
See a window without bringing it to the front: numbered elements [N] (role, name, value, states, position @x,y), and an image when the text is not enough. window: title (part of it), process ("notepad"), hwnd, or Windows itself: "taskbar" (buttons, tray, clock), "desktop" (icons), "screen" (whole screen as the user sees it, with the windows' places: overview only); omitted = current window. show: auto (default: the list, plus the image only when the tree is too thin to act on — canvas, game, page that publishes nothing — or after an unverified action), both (list and image), image, elements, changes (only what changed since the last list: added "+", changed "~", removed "-", the others keep their [N]), text (text of documents, no image), none. query: list only the elements containing this text. region [x1,y1,x2,y2]: zoom on an area of the image (fine reading; coordinates stay those of the full image). Images: WebP, at most 2000 px and 2.56 Mpx (detail=high gives the same size: zoom with region to read small text); an image identical to the last one sent for this window is not attached again (show=image always attaches it). marks: numbers drawn on the image (auto = unnamed elements; all; none).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| show | No | auto | |
| marks | No | auto | |
| query | No | ||
| detail | No | normal | |
| region | No | ||
| window | No | ||
| max_elements | No |