screen
Get a compact text list of on-screen elements with labels, tap points, and IDs to decide what to tap next. Unlike screenshots, it is cheaper and provides direct interaction points.
Instructions
Return a compact text list of the on-screen elements (label, tap point, id). Cheaper than a screenshot; use this to choose what to tap.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "screen"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |