vision_click
Click any UI element by describing it in words, even on canvas, Flutter, or Unity pages where the accessibility tree fails.
Instructions
Find a UI element by verbal description (via Claude vision) and click it. Fallback for canvas/Flutter/Unity pages where AX-tree fails. Requires [llm] extra.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| lease | No | Optional lease token to present if the target session is leased (0.7.0). Threaded per-call; never read from the server's env. | |
| button | No | left | right | middle (default left). | |
| intent | Yes | Verbal description of the element. | |
| session | No | Optional session name to target (omit for the shared 'default'). On a daemon shared with other agents, pass a UNIQUE name for stateful multi-step work (go→click→fill) so you don't collide on 'default'. | |
| max_per_minute | No | Rate limit. | |
| min_confidence | No | Minimum confidence (0..1). |