ai_screen_context
Capture a comprehensive screen snapshot for AI analysis, including screenshot with coordinate grid, accessibility tree, mouse position, and frontmost app info. Understand the current screen state to guide subsequent actions.
Instructions
[AI-Optimized] Capture a comprehensive snapshot of the current screen state for AI analysis. Returns: 1) Screenshot with coordinate grid overlay, 2) Accessibility tree of the frontmost app (interactive elements with positions), 3) Current mouse position, 4) Frontmost app info. Good for understanding screen context. For CLICKING elements, prefer ai_screen_elements which gives precise coordinates.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| maxDepth | No | Accessibility tree depth (default: 3) | |
| maxWidth | No | Max screenshot width (smaller = faster) (default: 1280) | |
| gridSpacing | No | Coordinate grid spacing in pixels (default: 100) | |
| includeScreenshot | No | Include screenshot image (default: true) | |
| includeAccessibility | No | Include accessibility tree (default: true) |