ui
Inspect and interact with mobile UI via accessibility tree. Search elements by text, label, or resource ID. Perform taps, analyze screens, and assert element visibility. Supports Android, iOS, desktop, and browser platforms.
Instructions
UI inspection and interaction. tree: accessibility tree. find: search elements. find_tap: fuzzy tap (Android). tap_text: tap by text (Desktop). analyze: screen analysis. wait/assert_visible/assert_gone: element checks.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| action | Yes | ||
| text | No | Element text to search/check (partial match, case-insensitive) | |
| label | No | iOS: Find by accessibility label | |
| resourceId | No | Android: Find by resource ID (partial match) | |
| className | No | Find by class name | |
| clickable | No | Android: Filter by clickable state | |
| visible | No | iOS: Filter by visibility | |
| showAll | No | Show all elements including non-interactive (tree only) | |
| compact | No | Compact output: only interactive elements, short format (tree only) | |
| format | No | Output format. semantic = grouped by role, minimal tokens | |
| description | No | Natural language description of element to tap (find_tap only) | |
| minConfidence | No | Minimum confidence score 0-100 for find_tap (default: 30) | |
| pid | No | Process ID of target application (tap_text only) | |
| exactMatch | No | Require exact text match for tap_text (default: false) | |
| fresh | No | Force bypass cache and fetch live UI tree | |
| timeout | No | Max wait time in ms for wait (default: 5000) | |
| interval | No | Poll interval in ms for wait (default: 500) | |
| platform | No | Target platform. If not specified, uses the active target. |