Open a URL; returns title, readiness, input labels and a short page preview. Returns popup details when one is present: inspect/resolve it with handle_popup using the user's requested choice. If ready is true, skip wait_until_ready. Use the returned field label in smart_type; a preview may reveal an interstitial instead of the requested page.

Click a uniquely named visible DOM target immediately; otherwise use D1 vision. Duplicate names are ambiguous. Reports method and UI change.

Fill a visible editable input, replacing old text; verify its exact value before optional Enter. Quote its accessible label from browser_open for a fast precise match. Check status and typed_verified before claiming success.

Scroll in steps until visual P(visible) reaches 0.80. Browser scroll is scoped to an active popup if present; prefer browser_scroll for deterministic scrolling without inference.

Evaluate up to 64 visual questions in one model call. answer=null means uncertain, not confirmation. Prefer DOM field labels and typed_verified for typing; avoid repeated visual assertions for an already verified action.

Wait for DOM readiness in hybrid mode, or visually in vision mode. Skip this call when browser_open returned ready=true. Readiness does not confirm task success or rule out a captcha.

Inspect a popup or explicitly accept/reject/dismiss it. Never assumes consent. Handles consent iframes and scrolls terms to unlock disabled buttons. Use the user's requested choice; reject never falls back to accept. popup_closed confirms closure; action_sent means do not repeat blindly.

Scroll without visual inference. auto scrolls an active popup or its terms panel; otherwise the page. Returns moved and at_end. Use container=popup to prevent scrolling the underlying page.

Move without clicking. desktop moves the real OS pointer using global screen pixels; browser moves the tab's mouse using viewport pixels and syncs the real OS pointer on visible browsers. Prefer smart_move when only a target description is known.

Click the real desktop pointer, optionally moving to global screen coordinates first. Browser mode requires x/y in the controlled tab viewport and moves the real OS pointer first. Use smart_click for semantic targets and handle_popup for an explicit consent choice.

Locate a described target and move/hover without clicking. Desktop mode uses a unique accessible control or D1 vision and the real OS pointer; browser mode uses DOM or D1 and moves both the tab mouse and the real OS pointer. Low confidence or a stale target prevents movement.

Move the pointer to (start_x, start_y), hold the mouse button, drag smoothly to (end_x, end_y), and release. Ideal for Paint tools, sliders, selections, and drag-and-drop.

Read-only platform requirements, accessible controls, and detected drawing canvas of the foreground app. Use exact labels in smart_click/type for the fast path; unavailable accessibility falls back to D1 vision.

Draw on a canvas by dragging the left mouse button. Accepts a single polyline [[x,y],...] or multiple strokes [[[x,y],...],...] (lifts the brush between strokes). Auto-detects the Paint/browser canvas sheet if canvas_bounds is omitted.

Draw a shape (line, rectangle, ellipse, circle, triangle, diamond, star, arrow, heart, house, spiral, wave) by dragging the mouse on the sheet. Auto-detects canvas_bounds and centers the shape on the canvas if coordinates are omitted.