Click
clickActivate a desktop or browser UI element using an accessibility ref, visual mark, or image point; returns what changed and the next observation ID.
Instructions
Click an element: prefer ref, then mark (from a som observation), then point (image pixels, last resort). Pass the observation_id you act on. Returns what changed and the next observation_id.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ref | No | ||
| mark | No | ||
| count | No | ||
| point | No | ||
| button | No | left | |
| modifiers | No | ||
| observation_id | Yes | observation_id of the observation you act on |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||