perform_secondary_action
Executes a specific accessibility action on a UI element to trigger secondary interactions such as opening context menus or scrolling, and returns the updated accessibility state.
Instructions
Perform an accessibility action exposed by the latest app state. Do not invent action names. A locked-parent Windows agent desktop calls the listed pattern directly without pointer fallback. On macOS, AXShowMenu and AXScrollToVisible are omitted from listings because nearly every element supports them. Returns the updated accessibility state after the action; a separate text-only get_app_state is normally unnecessary. Request a new screenshot before later coordinate input.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"app": "<app>",
"element_index": "<element_index>",
"action": "<action>"
},
"name": "perform_secondary_action"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| app | Yes | App name or full app path; macOS bundle ID; macOS and Windows pid:<pid>; Windows process name, window title fragment, or Start-menu shortcut name; Linux desktop entry name, executable name or window title fragment | |
| scope | No | macOS and Windows: element index from the latest returned state. Read only its retained subtree, renumbered from [1], including after actions. If it disappears, return the whole window with a notice. Linux returns INVALID_ARGUMENT. | |
| action | Yes | ||
| element_index | Yes | Element index from the latest returned app state |