ui_click_annotated
Click a UI element by its ID from an annotated screenshot. Get element IDs from a prior annotated screenshot to automate GUI interactions in .NET apps.
Instructions
Click an element by its ID from ui_take_annotated_screenshot.
Uses the numbered element from the last annotated screenshot. Call ui_take_annotated_screenshot first to get element IDs.
Args: element_id: Element ID number from the annotated screenshot generation: Generation counter from the screenshot response (optional, warns if stale)
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"element_id": "<element_id>"
},
"name": "ui_click_annotated"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| element_id | Yes | ||
| generation | No |