read_screen
Get an accessibility tree of visible windows to identify UI elements by reference, role, name, and position. Use it to locate interactive controls or read text before performing actions.
Instructions
Accessibility tree of windows: one line per element with [ref], role, name, @(x,y,w,h) box in screenshot pixels, value, states and actions.
Prefer refs over pixel guessing. Apps that do not expose accessibility (games, canvases, some Electron apps) show little or nothing; use screenshots and ocr there. 'positions=unresolved' means refs still work for actions but boxes are unknown.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| scope | No | 'focused' (active window), 'all' (every visible window), or an app name / window title substring | focused |
| filter | No | 'interactive' keeps controls; 'all' adds labels and text | interactive |
| ref_id | No | Only the subtree under this ref | |
| max_chars | No |