phone_ocr
Read on-device OCR text and positions from the Android screen to locate visible labels and custom-drawn controls missing from accessibility element maps.
Instructions
Read the text drawn on the screen (on-device OCR) with positions. Use when something you can see in a screenshot is missing from phone_elements: many apps hide tab bars, rows or custom-drawn buttons from accessibility. phone_tap with that text also falls back to OCR automatically.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "phone_ocr"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||