adb_screencap_annotated
Capture an Android screenshot with numbered UI element bounding boxes and a text legend so LLM workflows can reference elements by number instead of coordinates.
Instructions
Take a screenshot with UI element bounding boxes and numbered labels composited directly onto the image. Returns the annotated PNG path plus a text legend mapping each element number to its identity. Ideal for LLM workflows that need to reference specific UI elements by number rather than by coordinates.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "adb_screencap_annotated"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| device | No | Device serial | |
| filename | No | Output filename (default: annotated_<timestamp>.png) | |
| clickableOnly | No | Only annotate clickable/scrollable elements (default true — reduces visual noise) |