observe
Reads the current Android screen as one line per UI element with refs, labels, IDs, coordinates, and flags for precise targeting in subsequent actions.
Instructions
Current screen as one line per element: @ref Class "label" #id [x,y] flags. Use refs/text/id from here in act.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "observe"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||