accessibility_element_at
Identify the UI element at any screen coordinate to retrieve its role, title, value, position, and size. Use it to know what is under the mouse cursor at a specific location.
Instructions
Get the UI element at a specific screen coordinate. Returns the element's role, title, value, position, and size. Useful for identifying what is under the mouse cursor or at a specific screen location.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"x": "<x>",
"y": "<y>"
},
"name": "accessibility_element_at"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| x | Yes | X coordinate on screen | |
| y | Yes | Y coordinate on screen |