tool_element_action
Act on a UI element by its ref to press, set value, select, toggle, expand, collapse, scroll into view, or focus it without raising the window or injecting physical input.
Instructions
Perform an action on a UI element by the ref from element_at_point — this is the focus-free path: a UI Automation pattern is delivered to the element, so the window is never raised and z-order never matters. MUTATING (soft): serialized across agent sessions; NO physical input is injected, so it can run while the user types — just do not operate the very window the user is working in. action must be one of the actions listed for that element (press, set_value, select, toggle, expand, collapse, scroll_into_view, focus); set_value also needs text. Refuses with the supported list when the element does not offer the action.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ref | Yes | ||
| text | No | ||
| action | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||