Image understanding: describe an image, answer a question about it, or return structured fields (open vision model)
ai_visionUse when an agent must understand a picture (screenshot, product photo, chart, scene). Input: url of a png, jpeg, webp or gif (max 5 MB), optional question (max 1000 chars), optional json=true for fields (objects, text, people count, colors...). Output: answer or fields, image info, model. Does not name people; exact text: /v1/convert/ocr. Not stored. Example: ?url=https://upload.wikimedia.org/wikipedia/commons/4/47/PNG_transparency_demonstration_1.png Price: $0.006 USDC (Base or Solana) via x402.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "ai_vision"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public http(s) image URL (png, jpeg, webp, gif; max 5 MB). Bad or private URL → 400 before payment; non-image → 422, not charged | |
| json | No | true returns structured fields instead of free text | |
| question | No | What to ask about the image (default: a detailed description) |