ios_observe
Reads the iOS screen as a compact list of UI elements with short refs, ready for action tools. Narrow results by query or region when elements are omitted.
Instructions
Read the screen as a compact list of elements with short refs.
Each line is one element: e7 button "Send" @(340,70). Pass those refs
to the action tools rather than coordinates.
If the result says elements were omitted, narrow with query or
region instead of raising budget; a smaller answer is usually the
more useful one.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| query | No | Keep only elements whose text contains this. Use when truncated. | |
| budget | No | Token budget for the digest. Default 1500. | |
| region | No | Restrict to a screen area as [x, y, width, height]. | |
| include_elements | No | Also return each element as structured JSON. Roughly doubles the cost and duplicates the text form; only useful programmatically. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||