browser_computer
Control a browser tab with mouse, keyboard, and screenshots via DevTools Protocol. Perform clicks, typing, scrolling, and capture viewport images.
Instructions
Mouse, keyboard, and screenshots in a browser tab via the DevTools protocol; the tab does not need to be active (first use shows Chrome's "started debugging" info bar — that is expected). Actions: screenshot (viewport image in CSS pixels — its coordinates map 1:1 to click coordinates), zoom (magnified region [x0,y0,x1,y1]), left_click, right_click, double_click, triple_click, hover, left_click_drag (start_coordinate→coordinate), type (insert text at the current focus), key (space-separated combos, e.g. "cmd+a Backspace"), scroll (scroll_direction+scroll_amount), scroll_to (ref), wait (duration, max 10 s). Clicks, typing, and key presses are real input events and mutate page state; screenshot/zoom/hover/wait are read-only. Positions come from coordinate:[x,y] or from a ref returned by browser_read_page/browser_find — refs are more reliable than eyeballed coordinates.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ref | No | element ref from browser_read_page/browser_find — alternative to coordinate | |
| text | No | text for type, or key combos for key | |
| tabId | Yes | tab id from browser_tabs_list or browser_tab_create | |
| action | Yes | what to do; see the tool description for each action's required parameters | |
| region | No | [x0, y0, x1, y1] for zoom | |
| repeat | No | repeat count for key | |
| duration | No | seconds for wait (max 10) | |
| modifiers | No | click modifiers: cmd, ctrl, alt, shift (joined with +) | |
| coordinate | No | [x, y] in pixels | |
| scroll_amount | No | wheel ticks, default 3 | |
| scroll_direction | No | for scroll; default down | |
| start_coordinate | No | drag start for left_click_drag |