screen_elements
Lists visible text and touchable elements with center coordinates, type, id, and state to tap Android screen items by name instead of using a screenshot.
Instructions
What is on screen: each visible text or touchable element with its centre (x, y), type, id and state. Cheaper and more precise than a screenshot for tapping.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| serial | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |