batch
Run multiple desktop actions in one call—such as clicking, typing, and pressing keys—then return a screenshot. Use it to execute known multi-step UI sequences faster than separate calls.
Instructions
Run several actions in ONE call (much faster than one call per action), then return a screenshot. Use it whenever you already know the next few steps, e.g. click a field, type, press Enter.
Each action is an object with an "action" key plus that action's arguments: {"action": "click", "x": 100, "y": 200, "button": "left", "clicks": 1, "modifiers": ["ctrl"]} {"action": "move", "x": 100, "y": 200} {"action": "drag", "start_x": 1, "start_y": 2, "end_x": 3, "end_y": 4} {"action": "scroll", "direction": "down", "amount": 5, "x": 640, "y": 400} {"action": "type", "text": "hello"} {"action": "key", "keys": "ctrl+l", "repeat": 1} {"action": "hold_key", "keys": "shift", "seconds": 1} {"action": "wait", "seconds": 3} (returns early once the screen settles) {"action": "open_application", "name": "Google Chrome"} {"action": "focus_window", "query": "WhatsApp"} Coordinates refer to the most recent screenshot. Between steps that can change the UI (clicks, keys, scrolls) the screen is briefly allowed to settle. Stops at the first failing step.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"actions": "<actions>"
},
"name": "batch"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| actions | Yes | ||
| screenshot | No |