Use a cloud iPhone's screen
phone_ui_actCloud iPhone: Do steps on the Simulator in order and get back what changed. Steps: tap #id | tap "label" | tap @x,y | fill #id text | type text | scroll down | swipe left ["row"] | hold "label" [seconds] | set #slider 0-100 | back | home | key return | wait "text" [seconds] | gone "text". Text in any language can be typed and is read back; a tap that changes nothing is reported; the first failing step stops the rest.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"steps": "<steps>"
},
"name": "phone_ui_act"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| steps | Yes | One step per item, in the words phone_ui_look prints | |
| device | No | Name or UDID; default: the one in use | |
| session_id | No | The phone; default: the account's running phone | |
| request_key | No | Repeat a lost call with the same key |