Get UI Elements
get_ui_elementsRetrieve UI element tree from a mobile device screen to understand what is displayed and decide where to tap. Each element includes index, text, content description, class name, resource ID, bounding box with center coordinates, and boolean states (clickable, scrollable, focusable, enabled, selected, checked). By default returns only interactive elements; set interactive_only to false to get all elements.
Instructions
Retrieve the current UI element tree from the device screen. Each element includes its index, text, content description, class name, resource ID, bounding box with center coordinates (useful for tap targets), and boolean states (clickable, scrollable, focusable, enabled, selected, checked). By default only interactive elements are returned. Set interactive_only to false to get all elements. This is the primary tool for understanding what is on screen and deciding where to tap.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| device_id | Yes | Device serial ID | |
| interactive_only | No | Only return interactive elements (clickable, focusable, scrollable) |