click_ui
Click UI controls by accessible name or mark, focusing the window and using the real pointer to avoid screenshots and pixel guessing. Pass a name or mark; optional index resolves ambiguity.
Instructions
Click a control by its accessible NAME, or by a mark number from
the last marks capture, in ONE call: the exact coordinate comes from
the accessibility tree, the window is focused first, and the click goes
through the real pointer (visible cursor),
so no screenshot and no pixel estimation is spent. Pass exactly one of
name (matched against window's controls, exact accessible name
preferred, substring otherwise) or mark. An ambiguous name returns
the candidates instead of guessing: disambiguate with index (0-based
into that list) or a more specific name. Falls back with a note when
the app exposes no tree (use screenshot + zoom + pointer then).
then ('desktop'|'screenshot'|'ui'|'none') appends the result;
'ui' shows the click's effect on the controls in the same call.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mark | No | ||
| name | No | ||
| then | No | none | |
| index | No | ||
| button | No | left | |
| double | No | ||
| window | No | ||
| allow_auth | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |