ai_find_element
Locate UI elements by describing them in natural language. Searches the frontmost app's accessibility tree and returns matching elements with exact coordinates for automation.
Instructions
[AI-Optimized] Find a UI element by description in natural language. Searches the accessibility tree of the frontmost app and returns matching elements with their exact coordinates. Use this to locate buttons, text fields, menu items, etc.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| pid | No | Process ID of the app (omit for frontmost app) | |
| description | Yes | Natural language description of the element to find (e.g., "the Save button", "search text field", "close button") |