neuron_vision_act
Take a screenshot to see the page, analyze it visually, then click or type based on natural language instructions—no CSS selectors required. Use when page structure is unknown or selectors break.
Instructions
Take a screenshot of the page and describe what's visible, then perform an action based on visual understanding — no CSS selectors needed. The extension screenshots the viewport, the agent analyzes the image description, and issues click/type commands using element coordinates or best-match selectors. Use when you don't know the page structure or selectors keep breaking. Describe what you want to interact with in natural language.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| tabId | Yes | Chrome tab ID | |
| screenshot | No | Return the screenshot for the AI to analyze (default: true) | |
| instruction | Yes | What to do, described visually (e.g. 'click the blue Send button', 'type in the search box at the top', 'scroll to the comments section') |