desktop_ui_action
Perform UI automation actions on desktop controls by reference or selector to click, set values, focus, scroll, and manage window states.
Instructions
Perform a UI Automation action on a control identified by ref (from desktop_ui) or by selector (hwnd, automation_id, name, control_type, class_name, index).
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"action": "<action>"
},
"name": "desktop_ui_action"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ref | No | Control ref from desktop_ui, e.g. "s1.4". | |
| hwnd | No | ||
| name | No | ||
| text | No | ||
| index | No | ||
| value | No | ||
| action | Yes | ||
| prefix | No | ||
| suffix | No | ||
| instance | No | ||
| scroll_to | No | ||
| class_name | No | ||
| occurrence | No | ||
| control_type | No | ||
| automation_id | No | ||
| click_located | No | ||
| occurrence_mode | No |