Perceive Screen
perceive_screenCapture the current screen with numbered markers for every tappable and readable item, returning an annotated screenshot to guide precise actions.
Instructions
Capture the screen: numbered marks (som_id) for every tappable/readable item plus an annotated screenshot. ids are single-use and go stale after any action. ocr = auto (only when the accessibility tree is sparse) | always | never.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ocr | No | auto | |
| lang | No | eng | |
| device | No | ||
| max_marks | No | ||
| include_image | No |