ax_click
Press a UI control by matching its accessibility label or role. Works in the background without cursor movement.
Instructions
Press a UI control directly through the OS accessibility tree (macOS Accessibility; Windows UI Automation is not yet implemented and returns a clear error) — no coordinates, no cursor movement, works in the background (the app need not be frontmost). query is a case-insensitive substring of the element's accessibility role or label/title (e.g. "Send", "Search"). Targets the last window-captured app (or the frontmost app). Only works for apps that expose an accessibility tree; if it returns "no element matching" (or the not-implemented error), fall back to screenshot + left_click.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| query | Yes | Case-insensitive substring matching the target element's accessibility role or label/title (e.g. "Send", "Search", "AXButton"). |