adb_screencap_annotated
Capture a device screenshot annotated with numbered UI element boxes. Returns a labeled image and text legend for referencing elements by number in LLM workflows.
Instructions
Take a screenshot with UI element bounding boxes and numbered labels composited directly onto the image. Returns the annotated PNG path plus a text legend mapping each element number to its identity. Ideal for LLM workflows that need to reference specific UI elements by number rather than by coordinates.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| clickableOnly | No | Only annotate clickable/scrollable elements (default true — reduces visual noise) | |
| filename | No | Output filename (default: annotated_<timestamp>.png) | |
| device | No | Device serial |