phone_elements
Lists on-screen tappable elements, inputs, text, and coordinates so AI agents can inspect Android UI without taking a screenshot; set all=true to include covered elements for debugging.
Instructions
Text list of what is on screen: numbered tappable elements, inputs, text and their positions. Cheaper than a screenshot. all=true also lists elements hidden under sheets or dialogs (for debugging).
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "phone_elements"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| all | No | include elements covered by something on top |