screenstudio_desktop_action
Automate macOS app interactions by clicking, typing, scrolling, dragging, or pressing keys on a window to record or test workflows.
Instructions
One visible native step on an observed window: focus, move, click, doubleClick, drag, taps (a burst of count taps every intervalMs at one point, for mash buttons), hold (press for ms, then release), type, key (with modifiers, e.g. {key:'k',modifiers:['command']}; keys follow the person's keyboard layout) or scroll (optional x/y to scroll there; otherwise the pointer stays if it is over the window or moves to its middle). Coordinates are window-local points including the title bar. Pointer glides at a human pace and settles before clicking. Input stops if the window loses focus, another window covers the point, or the person moves the mouse. Terminals, password managers and System Settings are off limits unless SCREENSTUDIO_ALLOW_APPS names them; system shortcuts (command+space, command+tab, command+q) are never sent.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| pace | No | ||
| action | Yes | ||
| observationToken | Yes |