ui_click_annotated
Click a UI element by its ID from an annotated screenshot. Preceded by capturing the screenshot to obtain element numbers.
Instructions
Click an element by its ID from ui_take_annotated_screenshot.
Uses the numbered element from the last annotated screenshot. Call ui_take_annotated_screenshot first to get element IDs.
Args: element_id: Element ID number from the annotated screenshot generation: Generation counter from the screenshot response (optional, warns if stale)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| element_id | Yes | ||
| generation | No |