Ui
uiCapture a raw accessibility tree, phone state, and device context from a connected Android or iOS device so AI agents can inspect screens before tapping or typing.
Instructions
Raw UI snapshot (a11y_tree, phone_state, device_context, ...), as Device.ui().
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "ui"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| device | No | ||
| filter | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||