visual-understand-mcp
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@visual-understand-mcp What does this screenshot show?"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
视觉理解 MCP Server
为不支持视觉的编码模型提供图片理解能力。
原理
编码模型(如 GLM-5.1)遇到图片时,自动调用 MCP 工具 understand_image,由视觉模型完成图片识别,结果以文本回传给编码模型继续推理。无需切换模型,上下文不中断。
用户粘贴截图 → 编码模型调用 understand_image → 视觉模型识别 → 文字描述回传 → 继续编码Related MCP server: qwen-vision-mcp
安装方式一:通过 PyPI / uvx 使用(推荐)
MCP 配置示例:
{
"mcpServers": {
"visual-understand": {
"command": "uvx",
"args": ["visual-understand-mcp"],
"env": {
"VISION_API_BASE": "https://dashscope.aliyuncs.com/compatible-mode/v1",
"VISION_MODEL": "qwen-vl-max",
"VISION_API_KEY": "sk-xxx"
}
}
}
}安装方式二:本地源码运行
{
"mcpServers": {
"visual-understand": {
"command": "uv",
"args": [
"--directory", "/path/to/visual-understand-mcp",
"run", "visual-understand-mcp"
],
"env": {
"VISION_API_BASE": "https://dashscope.aliyuncs.com/compatible-mode/v1",
"VISION_MODEL": "qwen-vl-max",
"VISION_API_KEY": "sk-xxx"
}
}
}
}配置项
变量 | 说明 | 默认值 |
| 视觉模型 API 地址 | 无(必填) |
| 视觉模型名称 | 无(必填) |
| 视觉模型密钥 | 无(必填) |
| 输出随机性 |
|
| 最大输出长度 |
|
| 请求超时(秒) |
|
| 视觉模型系统提示词 | 见下方 |
前三个必填,其余可选。配置也可写入 ~/.visual-understand-mcp/config.json,env 优先级更高。
默认系统提示词:
你是一个图片分析助手,仅用于理解图片内容。请按以下结构分析图片,根据实际内容调整详细程度:1. 文字内容 — 逐字提取图中所有可见文字,保留原始格式和层级关系。2. 错误信息与代码 — 如果图中包含错误信息或代码片段,必须原样输出,不做任何改写或概括;如果没有则忽略此项。3. 视觉布局与元素 — 描述空间排列、尺寸、颜色及关键元素间的关系。UI 截图请识别组件类型及其状态。4. 数据与指标 — 图表、表格请提取数值、坐标轴、标签、趋势及异常数据点。5. 整体概述 — 概括图片的主题、场景和关键信息,提供完整的上下文理解。不适用的部分跳过。只描述图片中可见的内容,不做推理、猜测或延伸解读。保持精确客观,不推测不可见的内容。
建议写入 CLAUDE.md
进行图片识别任务时,使用 visual-understand MCP 的 understand_image 工具。本地调试
uv run mcp dev src/visual_understand_mcp/server.pyLicense
MIT
Available Tools
1 toolunderstand_imageA
调用视觉模型理解图片,将识别结果以文本返回。
当用户要求识别、分析、OCR、描述、比较图片或截图时,必须调用此工具。 这是唯一可以"看到"图片的工具,不要用 Read/cat 等文本工具打开图片文件。
Args: prompt: 图片理解任务描述,如"提取图中文字"、"分析截图中的报错信息"。 image_path: 单张本地图片路径。 image_url: 单张网络图片 URL 或 data:image base64 格式。 image_paths: 多张本地图片路径列表。 image_urls: 多张网络图片 URL 列表。
Inputs: prompt (required), image_url, image_path, image_urls, +1 more. Returns: result
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 1 tool
Only one tool exists, so there is no possibility of confusion between tools.
The single tool 'understand_image' follows a clear verb_noun pattern, which is consistent and intuitive.
With only one tool, the server feels thin for typical use cases; a broader domain like visual understanding might benefit from more specialized tools.
The tool's comprehensive description covers recognition, analysis, OCR, description, and comparison of both single and multiple images, leaving no obvious gaps.
Related MCP Connectors
Generate images from Claude, ChatGPT, Cursor and Codex with 12 top AI image models. Up to 4 images per call, SVG vectorization, background removal, upscaling and image-to-video. Remote MCP with OAuth, no API keys.
Generate images from Claude, ChatGPT, Cursor and Codex with 12 top AI image models and 10 tools: up to 4 images per call, SVG vectorization, editing and more. Remote MCP with OAuth, no API keys. Pay per image, no subscription.
Ask other AI models and generate images, speech, music and video from your coding agent.
Image & PDF tools for AI agents: compress, convert, resize, PDF, AI vision, pipeline.
Related MCP Servers
- FlicenseAqualityDmaintenanceGives any MCP client (OpenCode, Claude Code, Claude Desktop, Cursor, etc.) the ability to process images by automatically converting them to text descriptions using a vision model, so that text-only LLMs can handle image-based queries.2-
- AlicenseNot gradedqualityDmaintenanceEnables text-only models like Claude Code to recognize images by calling Qwen vision models from DashScope, returning text descriptions for continued reasoning.MIT
- AlicenseAqualityCmaintenanceGives text-only LLM coding agents vision by routing images to a multimodal model and returning detailed textual descriptions. Supports local files, URLs, clipboard, base64, raw bytes, and multiple providers like OpenAI, Anthropic, and Gemini.174 npm13MIT
- AlicenseAqualityBmaintenanceEnables text-only AI coding agents to analyze images and videos via vision-capable models (Gemini, Grok, OpenRouter), returning text descriptions for reasoning.234 npmMIT