Gemini Computer Use GUI & Browser Action Planner
operate_computer_use_agentAutomate interactive web UIs and desktop workflows that lack a direct REST API. Plan and execute OS-level clicks, typing, scrolling, and waits with Gemini Computer Use.
Instructions
Plans and executes OS-level desktop, browser DOM, and GUI coordinate actions (click, type, scroll, wait) using the Gemini Computer Use agent. Use when automating interactive web UIs or desktop workflows that lack a direct REST API; for running code-first API and terminal automation tasks, use execute_antigravity_agent instead. Stateless read-only edge call (max 32 KB, 60 RPM): accepts 'input' ('viewport_preset' defaults to 'desktop_1080p'), supports '?demo=true' or L402 (200 sats), and returns HTTP 400 if invalid.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| input | Yes | UI automation goal and target webpage or application context. | |
| viewport_preset | No | Target screen resolution for coordinate grounding; defaults to 'desktop_1080p' when omitted. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| agent | Yes | Computer Use model identifier ('computer-use-preview-2026'). | |
| output | Yes | Executed UI action sequence and extracted screen state. | |
| success | Yes | True when the UI workflow reached the target state. | |
| steps_executed | Yes | Number of GUI interaction steps performed. |