runtime_sandboxes_desktop_act
Drive a sandbox's Linux desktop like a person: start (width,height) returns a live view URL; move/click/drag/scroll the mouse by pixel coordinates; type text; press keys (xdotool names like ctrl+l, Return); list or focus windows; open a URL in Chromium; launch a program. Take runtime_sandboxes_desktop_screenshot to see the result.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| x | No | ||
| y | No | ||
| dx | No | scroll: wheel clicks, positive is right. | |
| dy | No | scroll: wheel clicks, positive is down. | |
| id | Yes | ||
| to | No | drag: [x, y] to release at. | |
| url | No | open: an http(s) address to open in Chromium. | |
| argv | No | launch: a program and its arguments. | |
| from | No | drag: [x, y] to press at. | |
| keys | No | key: xdotool names, e.g. "ctrl+l", "Return", "alt+Tab". | |
| text | No | type: the text to type. | |
| width | No | ||
| action | Yes | ||
| button | No | ||
| double | No | click: a double click. | |
| height | No | ||
| delayMs | No | type: pause between keystrokes. | |
| windowId | No | focus: an id from the window list. |