chat_with_vision
Analyze images with a Grok vision model: submit a prompt and image paths or URLs to receive detailed visual analysis.
Instructions
Analyze one or more images with a Grok vision model.
Args:
prompt: Question or instruction about the image(s).
session: Optional session name for persistent history in chats.
model: Vision-capable Grok model (default grok-4.3).
image_paths: Local image file paths to analyze.
image_urls: Public image URLs to analyze.
detail: Image detail level. One of "auto", "low", or "high".
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| model | No | grok-4.3 | |
| detail | No | auto | |
| prompt | Yes | ||
| session | No | ||
| image_urls | No | ||
| image_paths | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| text | No | Human-formatted output (includes footers, citations, cost summary). | |
| model | Yes | Actual executing model ID (e.g. 'grok-4.5'). | |
| plane | No | API | |
| route | Yes | High-level route (fast/agentic/research/etc.). | |
| tokens | No | Total tokens consumed. | |
| profile | No | Internal routing profile. | |
| session | No | Persistent session name. | |
| cost_usd | No | Exact USD cost from xAI billing metadata. | |
| response | Yes | Raw model output or primary content. | |
| citations | No | Native xAI/X citations with URL + snippet. | |
| latency_sec | No | ||
| response_id | No | Server-side stateful ID for continuation. | |
| finish_reason | No | unknown | |
| reasoning_effort | No | Grok 4.5+ native reasoning level. |