ui
Inspect and interact with mobile app UI elements across Android, iOS, and desktop. Access accessibility tree, search elements by text or attributes, perform taps, wait for visibility, and analyze screens.
Instructions
UI inspection and interaction. tree: accessibility tree. find: search elements. find_tap: fuzzy tap (Android). tap_text: tap by text (Desktop). analyze: screen analysis. wait/assert_visible/assert_gone: element checks.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| action | Yes | ||
| text | No | Element text to search/check (partial match, case-insensitive) | |
| label | No | iOS: Find by accessibility label | |
| resourceId | No | Android: Find by resource ID (partial match) | |
| className | No | Find by class name | |
| clickable | No | Android: Filter by clickable state | |
| visible | No | iOS: Filter by visibility | |
| showAll | No | Show all elements including non-interactive (tree only) | |
| compact | No | Compact output: only interactive elements, short format (tree only) | |
| format | No | Output format. semantic = grouped by role, minimal tokens | |
| description | No | Natural language description of element to tap (find_tap only) | |
| minConfidence | No | Minimum confidence score 0-100 for find_tap (default: 30) | |
| pid | No | Process ID of target application (tap_text only) | |
| exactMatch | No | Require exact text match for tap_text (default: false) | |
| fresh | No | Force bypass cache and fetch live UI tree | |
| timeout | No | Max wait time in ms for wait (default: 5000) | |
| interval | No | Poll interval in ms for wait (default: 500) | |
| platform | No | Target platform. If not specified, uses the active target. | |
| deviceId | No | Target device ID for multi-device. If omitted, uses active device. | |
| walkToClickable | No | If matched element is non-clickable (e.g., a TextView label), walk up to the smallest containing clickable ancestor. Default true. Set false to tap the matched element directly even if non-clickable (rare). |