List UI elements
ui_elementsLists buttons, fields, menus, links, tabs, and text in a macOS app's focused window via Accessibility, returning each element's id and screen center for reliable click/type_text control.
Instructions
List the buttons, fields, menus, links, tabs and text of the front app's focused window (or a named app) via Accessibility, each with an id and its center in screen points. Use the id with click/type_text: it's far more reliable than pixel guessing.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "ui_elements"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| app | No | App name; default is the front app |