Screenshot & Analyze
screenshot_and_analyzeCapture a specific screen region and get instant Gemini analysis in one call. Provide coordinates and a prompt to answer questions about on-screen content for agents without vision.
Instructions
Capture a screen region and immediately send it to Gemini for analysis in a single call. Combines screenshot_region and analyze_image. Useful for agents without native vision.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"x": "<x>",
"y": "<y>",
"width": "<width>",
"height": "<height>",
"prompt": "<prompt>"
},
"name": "screenshot_and_analyze"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| x | Yes | Top-left X coordinate in pixels | |
| y | Yes | Top-left Y coordinate in pixels | |
| model | No | Gemini model to use (default: gemini-2.5-flash) | |
| scale | No | Downscale factor for the screenshot before sending to Gemini | |
| width | Yes | Region width in pixels | |
| height | Yes | Region height in pixels | |
| prompt | Yes | What to analyze or ask about the screenshot | |
| include_cursor | No | Include the mouse cursor in the screenshot |