click_ui
Click a UI control by accessible name or mark number, using the accessibility tree for exact coordinates without screenshots. Handles ambiguous names by listing candidates for disambiguation.
Instructions
Click a control by its accessible NAME, or by a mark number from
the last marks capture, in ONE call: the exact coordinate comes from
the accessibility tree, the window is focused first, and the click goes
through the real pointer (visible cursor, same panic-kill guarantees),
so no screenshot and no pixel estimation is spent. Pass exactly one of
name (matched against window's controls, exact accessible name
preferred, substring otherwise) or mark. An ambiguous name returns
the candidates instead of guessing: disambiguate with index (0-based
into that list) or a more specific name. Falls back with a note when
the app exposes no tree (use screenshot + zoom + pointer then).
then ('desktop'|'screenshot'|'ui'|'none') appends the result;
'ui' shows the click's effect on the controls in the same call.
allow_auth=true overrides the refusal to click a system
authentication dialog.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mark | No | ||
| name | No | ||
| then | No | none | |
| index | No | ||
| button | No | left | |
| double | No | ||
| window | No | ||
| allow_auth | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |