ui-action
Interact with Android app UI by tapping, inputting text, or scrolling using accessibility selectors or coordinates.
Instructions
Interact with app UI: tap, input, scroll. Use selector or coords.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"operation": "<operation>"
},
"name": "ui-action"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| operation | Yes | ||
| x | No | ||
| y | No | ||
| elementIndex | No | ||
| selector | No | ||
| text | No | ||
| direction | No | ||
| amount | No | Scroll fraction (0-1, default: 0.5) | |
| deviceSpace | No | x/y in device-space (default true). Set false only for image-space coords. |