ui
Inspect mobile app UI trees, find and tap elements by text or description, analyze screens, and verify element visibility on Android and iOS devices.
Instructions
UI inspection and interaction. tree: accessibility tree. find: search elements. find_tap: fuzzy tap (Android). tap_text: tap by text (Desktop). analyze: screen analysis. wait/assert_visible/assert_gone: element checks.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| pid | No | Process ID of target application (tap_text only) | |
| text | No | Element text to search/check (partial match, case-insensitive) | |
| fresh | No | Force bypass cache and fetch live UI tree | |
| label | No | iOS: Find by accessibility label | |
| action | Yes | ||
| format | No | Output format. semantic = grouped by role, minimal tokens | |
| compact | No | Compact output: only interactive elements, short format (tree only) | |
| showAll | No | Show all elements including non-interactive (tree only) | |
| timeout | No | Max wait time in ms for wait (default: 5000) | |
| visible | No | iOS: Filter by visibility | |
| deviceId | No | Target device ID for multi-device. If omitted, uses active device. | |
| interval | No | Poll interval in ms for wait (default: 500) | |
| platform | No | Target platform. If not specified, uses the active target. | |
| className | No | Find by class name | |
| clickable | No | Android: Filter by clickable state | |
| exactMatch | No | Require exact text match for tap_text (default: false) | |
| resourceId | No | Android: Find by resource ID (partial match) | |
| description | No | Natural language description of element to tap (find_tap only) | |
| minConfidence | No | Minimum confidence score 0-100 for find_tap (default: 30) | |
| walkToClickable | No | If matched element is non-clickable (e.g., a TextView label), walk up to the smallest containing clickable ancestor. Default true. Set false to tap the matched element directly even if non-clickable (rare). |