get_elements
Get a JSON array of all UI elements on the current screen, including text, bounds, and clickability, to understand the layout before taking action.
Instructions
Get all UI elements on the current screen as a JSON array. Each element has: idx, text, content_desc, resource_id, class, bounds, center, clickable, scrollable. Use element idx with tap_element(). Call this to understand the screen layout before acting.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"device": "<device>"
},
"name": "get_elements"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| device | Yes | ||
| interactive_only | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |