desktop_click
Click a specified point in a target window using screenshot coordinates, after validating the target to avoid expired snapshots, layout changes, or covered elements.
Instructions
Click screenshot-image coordinates in the target window or its observed menus, automatically choosing independent or foreground pointer input after target validation. Rejects expired snapshots, changed window layout/identity and covered targets. Snapshot validity does not prove unchanged application content; observe again after content transitions before selecting a control.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"window_id": "<window_id>",
"snapshot_id": "<snapshot_id>",
"x": "<x>",
"y": "<y>"
},
"name": "desktop_click"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| x | Yes | ||
| y | Yes | ||
| count | No | ||
| button | No | left | |
| window_id | Yes | ||
| snapshot_id | Yes |