ui-action
Interact with Android app UI by tapping, inputting text, or scrolling using accessibility selectors or coordinates.
Instructions
Interact with app UI: tap, input, scroll. Use selector or coords.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| operation | Yes | ||
| x | No | ||
| y | No | ||
| elementIndex | No | ||
| selector | No | ||
| text | No | ||
| direction | No | ||
| amount | No | Scroll fraction (0-1, default: 0.5) | |
| deviceSpace | No | x/y in device-space (default true). Set false only for image-space coords. |