ui_take_annotated_screenshot
Capture a screenshot of the UI with numbered labels on interactive elements for automated clicking by number.
Instructions
Take a screenshot with numbered UI elements overlaid (Set-of-Mark pattern).
Returns annotated WebP image + compact element index. Each interactive element gets a numbered label on the screenshot.
Use ui_click_annotated(element_id) to interact with elements by number.
Args: max_depth: How deep to traverse the UI tree (default 3) interactive_only: Only interactive elements (default True) max_width: Max image width (default 1024) format: Image format: "webp" (smallest), "jpeg", "png" compact: Compact element index — id+name only (default True, saves ~60KB)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| max_depth | No | ||
| interactive_only | No | ||
| max_width | No | ||
| format | No | webp | |
| compact | No |