vision_inspect
Analyze a single image to extract content, understand UI layouts, interpret charts, or identify errors using customizable modes and OCR.
Instructions
Analyze a single image: screenshot understanding, UI analysis, chart comprehension, error extraction. Use this tool ONLY when the user has an image and wants to understand its content, extract information, or analyze visual elements. Do NOT use for: comparing two images (use vision_diff), cropping/verifying a region (use vision_crop_verify).
Supports automatic detection of input format via image_source parameter (recommended):
Local file path (e.g. /path/to/image.png)
HTTP/HTTPS URL (e.g. https://example.com/image.png)
Base64 data URI (e.g. data:image/png;base64,...)
Plain base64 string (auto-detected by file header)
Args: image_source: Image source - local file path or remote URL (recommended, auto-detects format) image_path: Local image file path (backward compatible, prefer image_source) task: Analysis task description mode: Analysis mode (general|game_ui|web_ui|error|chart|diagram|design_to_code) need_ocr: Whether to enable OCR need_bbox: Whether to detect element bounding boxes detail_level: Detail level (normal|high) max_tokens: Maximum output tokens image_data: Base64 encoded image data (backward compatible)
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | No | general | |
| task | No | 分析这张图片 | |
| need_ocr | No | ||
| need_bbox | No | ||
| image_data | No | ||
| image_path | No | ||
| max_tokens | No | ||
| detail_level | No | normal | |
| image_source | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |