send_input
Send keyboard or mouse input to control desktop applications, using screenshot coordinates for precise mouse actions.
Instructions
Send keyboard or mouse input via ydotool.
For mouse mode with coordinates from a screenshot, pass the metadata JSON string from the screenshot response as screenshot_meta.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"mode": "<mode>"
},
"name": "send_input"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | Yes | ||
| keys | No | ||
| key | No | ||
| action | No | ||
| x | No | ||
| y | No | ||
| button | No | left | |
| window | No | ||
| screenshot_meta | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |