capture_window
Captures a specific app window on screen and analyzes it with a local vision model, enabling live UI inspection for testing desktop applications.
Instructions
Capture a specific app window currently visible on screen and analyze it with a local Ollama vision model. Unlike analyze_screenshot, this sees your real browser with your logged-in session and live state — ideal for testing local apps.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| crop | No | Crop to a sub-region before analysis. All values are fractions 0–1. E.g. bottom half: {x:0, y:0.5, width:1, height:0.5} | |
| model | No | Ollama vision model to use (defaults to OLLAMA_MODEL env var, or gemma4:e4b) | gemma4:e4b |
| scale | No | Upscale factor applied before sending to the vision model. Use 2 or 3 for small terminal text or dense UIs. | |
| app_name | Yes | Exact macOS app name, e.g. 'Google Chrome', 'Safari', 'Terminal', 'Cursor' | |
| question | Yes | What to analyze or look for in the screenshot | |
| window_index | No | Which window to capture if the app has multiple (1 = frontmost) |