describe_ui
Get the accessibility tree of the current iOS screen, returning elements with label, type, value, enabled, and frame. Filter to interactive labeled elements for targeted actions.
Instructions
PRIMARY PERCEPTION. Return the accessibility tree of the current screen as a list of elements (label, type, value, enabled, frame). Reason over this and tap by label.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "describe_ui"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| interactive_only | No | If true, return only elements that have a label. | |
| udid | No | Target simulator UDID. Defaults to the booted sim. |