act
Run ordered UI steps on a macOS app window in the background without taking focus, moving the pointer, or changing the clipboard. Stops at first failure and returns what changed.
Instructions
Run steps on an app's window in the background, without touching the user's focus, pointer or clipboard. Steps run in order, each waits until the app has finished reacting, and the batch stops at the first failure. Returns what changed. Put several steps in one call. Steps: click REF|X,Y · double REF · right REF · set REF VALUE · type [REF] TEXT · key COMBO [xN] · menu A > B · pick REF OPTION · select REF · focus REF · scroll REF up|down|left|right [N] · show REF · drag REF|X,Y to REF|X,Y (to a ref: takes its place) · wait gone REF|REF|text "T"|500ms [within 10s] · lane (move the app's windows off screen, where they still render and take clicks)
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"app": "<app>",
"steps": "<steps>"
},
"name": "act"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| app | Yes | ||
| steps | Yes | ||
| window | No |