computer.observe
Observe the current screen and UI state—geometry, active window, cursor, OCR text, and accessibility elements—to understand what's on screen before acting. Levels adjust detail: minimal, normal, full.
Instructions
Observe the current computer state: screen geometry, active window, cursor, OCR'd on-screen text and accessibility UI elements. Levels: 'minimal' (fast), 'normal' (screenshot+OCR+accessibility), 'full' (adds focused element details). This is the primary tool for understanding the screen before acting.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| level | No | normal |