computer
Perform mouse and keyboard actions in a browser tab: click coordinates or element refs, type text, press keys, scroll, wait, take screenshots, and zoom regions for detailed inspection.
Instructions
Mouse and keyboard actions in a tab. Click actions take either a coordinate (from the latest screenshot) or a ref. Actions: left_click, right_click, double_click, triple_click, hover, type (text into the focused element), key (space-separated keys like "Enter", "ctrl+a", "Backspace Backspace"), scroll, scroll_to (ref), wait, screenshot, zoom (region of the screenshot at higher detail).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"action": "<action>"
},
"name": "computer"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ref | No | Element reference from read_page/find, e.g. "ref_12". | |
| text | No | Text for type, or keys for key. | |
| tabId | No | Tab to act on. Defaults to the active tab of the focused Zen window. | |
| action | Yes | ||
| region | No | [x0, y0, x1, y1] for zoom, in screenshot pixels. | |
| duration | No | Seconds to wait (wait action). | |
| coordinate | No | [x, y] in screenshot pixels. | |
| scroll_amount | No | Scroll ticks (default 3). | |
| scroll_direction | No |