look
Inspect a named window in the background, including covered windows, to list labeled UI elements, values, and states before sending one verified action batch.
Instructions
GOLDEN RULE: look → act in one batch, targets by label; never resend a batch without looking. See a NAMED window (hwnd: number, title or process) WITHOUT bringing it to the front (covered ones too): one line per element "[N] role "name" = "value" states @x,y"; image (WebP ≤ 2000 px) only if the tree is too thin, or with capture_screenshot=true, annotate (numbers drawn) or zoom=box_2d (area enlarged); query filters; format="json": compact JSON (box_2d 0-1000 per element). Same screen as the last image sent: not attached again. Unlocks a batch. Example: {"hwnd": "Notepad", "query": "save"}
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| hwnd | No | ||
| zoom | No | ||
| query | No | ||
| format | No | text | |
| annotate | No | ||
| max_depth | No | ||
| output_path | No | ||
| max_elements | No | ||
| capture_screenshot | No |