read_screen
Reads the Android phone screen as UI elements with IDs, text, and tap coordinates, so agents can inspect state before and after actions.
Instructions
Read what is on the phone screen as a list of UI elements with ids, text, and tap coordinates. Call this first and after every action to see the result. Element ids are only valid until the next read_screen. Elements can also show a field's error, its hint, a heading, a tooltip or a pane title; "(covered by ...)" means a tap there would land on something else. A toast that just showed is listed at the end.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "read_screen"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||