android_explore_and_click
Discover and click Android UI elements via Shadow DOM scanning, bounded scrolling, and graph routing, with hazardous-action confirmation; returns ranked candidates if no confident match.
Instructions
Dynamic Shadow DOM discovery + click with optional A* graph/prefix routing, bounded list scrolling (down/up), hazardous action HITL guard, and automatic Spatial Graph edge recording. Returns top-20 PII-redacted interactive candidates (needs_selection, isError: false) if no confident match is found.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"target": "<target>"
},
"name": "android_explore_and_click"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| target | Yes | Target UI label, resource_id suffix, content_desc, or breadcrumb path (e.g. 'Night Light', 'Display > Night Light'). | |
| confirmed | No | Set to true ONLY after explicit human confirmation in chat to click hazardous/irreversible elements. Default: false. | |
| max_scrolls | No | Maximum bounded discovery scrolls (0-10). Default: 3. | |
| device_serial | No | Optional ADB device serial. Defaults to the first connected device. | |
| step_timeout_ms | No | Per-step Shadow DOM settlement timeout in ms (250-10000). Default: 2000. | |
| prefer_graph_route | No | Try known A* graph route (or nearest known prefix vertex) before scanning live Shadow DOM. Default: true. |