computeruse_observe
Capture the current screen and visible UI elements to obtain structured dimensions, element IDs, and an image for accurate click and type decisions.
Instructions
Capture the current screen and optionally visible UI Automation elements. Returns structured screen dimensions, element IDs, and an MCP image. Use this before each click/type decision.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| image_mode | No | planner returns the ruler/element-overlay image; raw returns the plain screenshot; none returns JSON only. | planner |
| monitor_index | No | ||
| include_elements | No |