Desktop: Snapshot
desktop_snapshotCapture the current desktop state, including cursor position, open windows, and interactive UI elements. Include a screenshot with use_vision or skip UI extraction for a vision-only pass.
Instructions
Capture the current desktop state: screenshot, cursor position, open windows, and interactive UI elements. Set use_vision=true to include a screenshot. Set use_ui_tree=false for a faster vision-only pass. Requires desktop_permission in the active mission step.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| display | No | Limit to specific display indices (0-based). Omit for all screens. | |
| use_vision | No | Include a screenshot in the response. | |
| use_ui_tree | No | Extract interactive UI elements (slower but richer). |