act
Execute verified batches of UI steps on a named window in the background, targeting labels and requiring confirmation tokens for outward or destructive operations.
Instructions
Act in ONE batch, in the background, on a NAMED window (hwnd), without reading the code: shared token, emergency stop and the user's pause are handled here.
Actions: click, double_click, right_click, type, set, clear, check, uncheck, select (option), expand, collapse, menu (path), key, scroll, drag, hover, wait (seconds, text), focus.
Target: target="Exact label", "#N", box_2d or x/y; ambiguous label refused. Steps ✓ = ~ ✗, status = the worst; follow next. Batch stopped on ~ or ✗, nothing more sent and no replay; look before resuming after an unknown outcome.
Outward actions (paying, sending, publishing, transferring, and the Enter key that would trigger them): confirm: true AND accord: "<token>" (on the step or as a parameter), returned by the first refusal that describes the exact action. Local destruction (permanent deletion, uninstalling, formatting, resetting): confirm: true alone. The user's explicit order = confirmation; your own initiative = ask first. Same batch without a look: refused.
foreground=True: real mouse/keyboard as a fallback only.
Example: {"hwnd": "Order", "steps": [{"action": "set", "target": "Name", "text": "Alice"}, {"action": "check", "target": "Accept"}, {"action": "click", "target": "Submit"}]}
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| hwnd | No | ||
| then | No | none | |
| steps | Yes | ||
| accord | No | ||
| repeat | No | ||
| foreground | No | ||
| time_budget | No |