Snapshot Android UI
mobile_ui_snapshotInspect an Android display's accessibility tree to get element refs and exact tap coordinates, then use those refs for tap, swipe, drag, or text actions.
Instructions
Return parsed accessibility nodes, each with a ref (@nN) and the point that actually routes a tap to it. Pass ref to tap, double-tap, long-press, swipe, drag, or text. Refs are shared across HTTP requests until the next UI read on this serial and display. Portable ADB supports only display 0; other displays use the companion hierarchy when a companion session is active.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| serial | Yes | Exact ADB serial from mobile_devices_list; never inferred when multiple devices exist | |
| displayId | Yes | Android framework logical display ID, not a SurfaceFlinger physical ID |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| nodes | Yes | ||
| serial | Yes | ||
| backend | Yes | ||
| displayId | Yes | ||
| truncated | Yes |