clipboard-vision-mcp
clipboard-vision-mcp
为 Opencode (DeepSeek V4, GLM 5.1) 中的纯文本模型添加视觉能力 — 直接查看剪贴板中的图像,无需手动保存文件。
已在 Windows 11 + Opencode + DeepSeek V4 Pro 上测试。 支持多操作系统剪贴板(Windows / macOS / Linux X11 / Linux Wayland)。
派生自 itcomgroup/vision-mcp-server — 围绕“剪贴板优先”工具、安全加固、跨平台剪贴板提取以及一键式 AI 安装进行了重写。
问题所在
像 DeepSeek V4 和 GLM 5.1 这样廉价/快速的纯文本模型非常适合处理代码,但它们无法读取图像。每次粘贴截图时,模型都会要求你将其保存到磁盘并提供路径。
Related MCP server: visual-understand-mcp
解决方案
此 MCP 服务器公开了 *_from_clipboard 工具。当 LLM 需要查看你的截图时,它会调用 analyze_clipboard — 服务器读取剪贴板图像,将其发送到真实的视觉模型 (Groq + Llama-4 Scout,免费层级),并返回文本模型可以理解的文本描述。
结果:粘贴 → 提问 → 完成。 无需文件搬运。
🤖 通过 AI 一键安装(推荐)
无需手动执行以下步骤,只需将以下提示词之一粘贴到任何编码助手(DeepSeek、GLM、Claude、GPT 等)中,它就会为你完成所有设置 — 克隆、虚拟环境、依赖项、MCP 配置、快捷键:
更喜欢自己动手?请继续阅读。
功能特性
🖼️ 剪贴板优先 —
analyze_clipboard、extract_text_from_clipboard、diagnose_error_from_clipboard、describe_ui_from_clipboard、code_from_clipboard。📁 文件路径回退 — 同样的工具也适用于磁盘上已有的图像。
🆓 免费视觉后端 — Groq 的免费层级,提供 Llama-4 Scout (17B, 多模态)。
🖥️ 多操作系统 — Windows、macOS、Linux (X11 + Wayland)。
🔒 安全加固 — 扩展名/大小/魔数验证,分析后自动删除剪贴板临时文件。
🔌 MCP 标准 — 适用于 Opencode、Claude Code、Cursor、Cline、Continue 或任何支持 MCP 的客户端。
要求
Python 3.10+
Groq API 密钥(免费,30 秒注册):https://console.groq.com/keys
支持 MCP 的客户端(Opencode、Claude Code、Cursor、Cline、Continue 等)
Python 依赖项(通过 pip install -e . 自动安装)
包 | 用途 |
| MCP 协议服务器 |
| Groq API 客户端 (Llama-4 Scout 视觉) |
| 异步文件 I/O |
| 剪贴板图像提取 (Windows/macOS), PNG 编码 |
操作系统特定的剪贴板依赖项
操作系统 | 命令 | 原因 |
Windows | 无需额外操作 | Pillow + pywin32 原生处理剪贴板。 |
macOS |
| Pillow 在大多数情况下有效;pngpaste 作为备份。 |
Linux — Wayland |
| 提供 |
Linux — X11 |
| 或你发行版对应的等效命令。 |
快速入门
1. 获取免费的 Groq API 密钥
2. 安装
git clone https://github.com/Capetlevrai/clipboard-vision-mcp.git
cd clipboard-vision-mcp
python -m venv .venv
# Windows:
.venv\Scripts\activate
# macOS/Linux:
source .venv/bin/activate
pip install -e .3. 冒烟测试(无需 Groq)
复制任意截图,然后:
python examples/smoke_test.py预期结果:OK: clipboard image saved to <path>。
4. 连接到你的 MCP 客户端
查看 docs/OPENCODE.md 了解 Opencode(已在 Windows 测试),或查看 docs/CLIENTS.md 了解 Claude Code / Cursor / Cline / Continue。
Opencode (%APPDATA%\opencode\opencode.json (Windows), ~/.config/opencode/opencode.json (Linux/macOS)):
{
"mcp": {
"clipboard-vision": {
"type": "local",
"command": [
"C:\\path\\to\\clipboard-vision-mcp\\.venv\\Scripts\\python.exe",
"-m",
"clipboard_vision_mcp"
],
"enabled": true,
"environment": {
"GROQ_API_KEY": "gsk_your_key_here"
}
}
}
}💡 使用虚拟环境 Python 的绝对路径。 这能确保 MCP 无论在什么 shell、当前工作目录或激活的虚拟环境下都能以正确的依赖项启动。
5. ⚠️ Opencode 粘贴图像的快捷键
Opencode 默认不将图像粘贴绑定到 Ctrl+V / Alt+V。如果不执行此步骤,复制截图并点击粘贴将不会插入任何内容(或仅插入纯文本)。
编辑你的 Opencode keybinds.json 或 opencode.json 中的 keybinds 部分:
{
"keybinds": {
"input_paste": "ctrl+v",
"input_paste_image": "alt+v"
}
}编辑后重启 Opencode。
6. Windows 重启后会自动启动吗?
是的。 Opencode 在每次启动时都会重新读取 opencode.json,并自动生成任何 "type": "local" 且 "enabled": true 的 MCP 服务器。由于命令使用了虚拟环境 Python 的绝对路径,因此 Opencode 从哪个 shell 或工作目录启动并不重要。
重启 → 打开 Opencode → 列出 clipboard-vision 工具。无需手动步骤。
使用方法
You: (copy a screenshot to clipboard, then type)
"Look at what I just copied and tell me what's wrong with this error."
LLM (DeepSeek, GLM, Claude, ...): [calls diagnose_error_from_clipboard]
→ "The error says `ECONNREFUSED 127.0.0.1:5432`. Postgres isn't
running on port 5432. Start it with: ..."纯文本模型永远看不到像素 — 它读取 Llama-4 Scout 返回的描述并进行推理。
工具参考
工具 | 输入 | 使用场景 |
| 可选 | 通用描述,对剪贴板图像进行问答。 |
| — | 纯 OCR。 |
| — | UI/UX 审查,组件清单。 |
| — | 错误截图 → 原因 + 修复。 |
| — | 从截图中提取代码。 |
|
| 磁盘上已有的图像。 |
|
| 同上,针对文件。 |
安全性
此服务器作为本地 stdio 进程运行 — 它不打开任何网络端口,仅通过 stdin/stdout 与 MCP 客户端通信,并通过 HTTPS 与 Groq API 通信。
已实施的加固措施:
文件类型允许列表。
analyze_image和其他文件路径工具仅接受.png .jpg .jpeg .gif .webp .bmp。这防止了提示词注入的 LLM 要求服务器读取任意本地文件(~/.ssh/id_rsa、.env等)并将其作为 base64 泄露给 Groq。魔数检查。 上传前会根据已知的图像头验证文件内容。
大小限制。 每张图像最大 20 MB。
自动删除剪贴板临时文件。 每次分析后删除。截图可能包含机密信息(令牌、聊天记录、凭据)— 服务器将其写入
$TMPDIR/clipboard_vision_mcp/并在完成后取消链接。无遥测。 无分析,无回传。
此项目无法保护你的方面
你的 API 密钥以明文形式存储在 MCP 客户端配置中。 这就是目前 MCP 客户端的工作方式。请确保该配置文件不可被他人读取,且永远不要提交到版本控制中。如果你不小心泄露了密钥(聊天、截图、git 推送),请在 https://console.groq.com/keys 处轮换密钥。
Groq 会接收你分析的图像。 在发送任何敏感内容之前,请查看他们的 隐私政策。
任何 MCP 工具都是在 LLM 的指令下执行的。 如果你将一个被提示词注入的模型连接到此服务器并输入不受信任的内容,模型可以选择要分析的内容。上述允许列表减少了影响范围,但无法完全消除。
发现问题?
请提交 私有安全建议,而不是公开问题。
工作原理
┌──────────────┐ MCP ┌─────────────────┐ HTTPS ┌─────────────────┐
│ Opencode │ ──────▶ │ clipboard- │ ────────▶ │ Groq API │
│ (DeepSeek) │ │ vision-mcp │ │ Llama-4 Scout │
└──────────────┘ └─────────────────┘ └─────────────────┘
│
▼
reads system clipboard
(PIL / wl-paste / xclip)
→ validate → base64 → send → delete故障排除
"Clipboard does not contain an image." — 复制真实的图像,而不是文件图标或文本。在 Linux 上,验证
wl-paste --type image/png或xclip -selection clipboard -t image/png -o | file -在 MCP 之外是否有效。"GROQ_API_KEY is not set." — 检查客户端配置中的
environment块,然后完全重启客户端。工具未在 Opencode 中显示。 — 检查 Opencode 的 MCP 日志。手动运行
python -m clipboard_vision_mcp— 它应该启动并静默等待 stdin。"Refusing to read '' — only image files are allowed." — 你(或 LLM)传递了一个非图像路径。这是安全防护在发挥作用。
致谢
派生自 itcomgroup/vision-mcp-server — 原始的 Groq + Llama-4 Scout MCP 集成。
视觉模型:Llama-4 Scout 17B,由 Groq 提供。
许可证
MIT — 参见 LICENSE。
Available Tools
12 toolsanalyze_chartC
Analyze a chart image file.
| Name | Required | Description | Default |
|---|---|---|---|
| image_path | Yes | Absolute path to the image file. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, so the description must carry behavioral disclosure. It only states the action but does not describe side effects, output format, or if the operation is read-only.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single sentence with no extraneous content. It is efficient, though it could benefit from slightly more detail without being verbose.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simple tool (one parameter, no output schema), the description is too brief. It does not explain what 'analyze' entails (e.g., extract text, generate summary), leaving the agent uncertain about the output.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with a clear parameter description. The tool description adds no additional meaning beyond what the schema already provides, meeting the baseline for high coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The tool name and description clearly state it analyzes a chart image file. However, it does not differentiate from sibling tools like 'analyze_image' or 'describe_ui', which may have similar functionality.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool over alternatives. The description lacks context about prerequisites or exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
analyze_clipboardA
Read the image currently in the system clipboard and analyze it. Use this when the user says 'look at this', 'what's in my clipboard', or pastes a screenshot without providing a file path. Optional prompt overrides the default description request.
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | No | Custom question about the clipboard image. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must disclose behavior but only states 'read and analyze'. It does not mention side effects, permissions, return type, or limitations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences, front-loaded with primary action, no wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
No output schema, so description should hint at return type. It only says 'analyze it', leaving ambiguity about what the agent receives back. Adequate but not complete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema covers 100% of parameters, and description adds value by explaining that the default analysis is a description request and the prompt parameter overrides it.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool reads and analyzes the clipboard image, with explicit example triggers like 'look at this' and 'what's in my clipboard'. This distinguishes it from siblings like 'code_from_clipboard' or 'analyze_image'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It specifies when to use (user says certain phrases or pastes screenshot without file path) and mentions optional prompt override. However, it does not explicitly exclude situations where sibling tools would be better.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
analyze_imageC
Analyze an image file. Provide image_path and optional prompt.
| Name | Required | Description | Default |
|---|---|---|---|
| image_path | Yes | ||
| prompt | No |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are present, and the description does not disclose behavioral traits such as read-only status, required permissions, performance characteristics, or side effects. The description only states the action without any operational context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise, consisting of a single sentence that front-loads the purpose. It avoids unnecessary words, but the brevity leaves out important details.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's potential complexity (image analysis), the lack of output schema and minimal description make it incomplete. The agent does not know what the tool returns or any constraints (e.g., file size limits, supported formats).
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, yet the description only reiterates that image_path is required and prompt is optional. It does not explain what valid values for image_path (e.g., file path vs URL) or how the prompt influences analysis. This adds minimal value beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'Analyze' and the resource 'image file', making the purpose understandable. However, it does not differentiate from sibling tools like analyze_chart or code_from_screenshot, which also involve image analysis.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus its siblings (e.g., analyze_chart, code_from_screenshot). There is no mention of prerequisites or context in which this tool is appropriate.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
code_from_clipboardB
Extract code from a clipboard screenshot, identifying the language.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose all behavioral traits. It states the action and outcome but omits details about how the clipboard is accessed, potential error cases (e.g., no image in clipboard, unsupported format), and whether any side effects occur. The tool's behavior is partially transparent but lacks completeness.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence of 7 words, extremely concise. It front-loads the primary action 'Extract code' and adds the key detail 'identifying the language'. While efficient, it is so brief that some context is missed, preventing a perfect score.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no parameters and no output schema, the description should at least clarify the input source (e.g., reads current clipboard content). It does not explicitly state that the tool reads from the clipboard automatically, though the name implies it. Sibling tools provide more context, making this one minimally complete but adequate for basic understanding.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has no parameters, so the description need not add parameter meaning. Since there are 0 parameters, the description is not required to elaborate. The baseline of 4 is appropriate as it does not mislead or omit necessary parameter information.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool extracts code from a clipboard screenshot and identifies the language. It specifies the verb 'extract', the resource 'code from clipboard screenshot', and the additional outcome 'identifying the language'. This clearly distinguishes it from siblings like 'code_from_screenshot' which loads from file, and 'extract_text_from_clipboard' which is for general text.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives such as 'code_from_screenshot' or 'analyze_clipboard'. It does not mention prerequisites, like having a valid screenshot in the clipboard, nor does it specify when not to use it. Usage is only implied.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
code_from_screenshotB
Extract code from a screenshot file.
| Name | Required | Description | Default |
|---|---|---|---|
| image_path | Yes | Absolute path to the image file. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description bears full responsibility for disclosing behavior. It does not mention that this likely uses OCR, supported image formats, accuracy limitations, or whether it returns textual code or a file path.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise (one sentence) and front-loaded with the key information. It is not verbose, though it could be expanded without losing efficiency.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (single parameter, no output schema), the description is minimally adequate but lacks details about return value (e.g., raw text or code snippet) and edge cases.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% (image_path described adequately), but the description adds no additional meaning, such as the expected image format or path syntax. Baseline 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb 'Extract' and resource 'code from a screenshot file', clearly stating the tool's function. It implicitly distinguishes from sibling tools like 'code_from_clipboard' by specifying the source as a file.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives such as 'code_from_clipboard', 'extract_text', or 'analyze_image'. No context about prerequisites or exclusions is given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
describe_uiC
Describe a UI screenshot file.
| Name | Required | Description | Default |
|---|---|---|---|
| image_path | Yes | Absolute path to the image file. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description carries full burden of behavioral disclosure, yet it only states 'describe' without indicating output format, response limitations, or any behavioral traits. This is insufficient for an agent to understand what the tool does beyond the simple verb.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with one sentence, but it lacks structure and additional needed context. It is not verbose, but the conciseness comes at the cost of missing critical information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the simplicity and full schema coverage, the description is incomplete. It omits output details (e.g., format, content), fails to differentiate from siblings, and does not leverage the schema to provide richer context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% with a clear parameter description ('Absolute path to the image file'). The tool description adds no extra meaning beyond the schema, so it meets the baseline of 3 but does not elevate it.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb 'describe' and the resource 'UI screenshot file'. However, it does not distinguish itself from sibling tools like analyze_image or describe_ui_from_clipboard, as it lacks specific scope or method differentiation.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided on when to use this tool versus alternatives. Siblings such as describe_ui_from_clipboard (clipboard input) and analyze_image (broader analysis) exist, but no usage context, prerequisites, or exclusions are given.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
describe_ui_from_clipboardA
Describe the UI in a clipboard screenshot (layout, components, state).
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided. Description only states it describes, implying read-only, but does not disclose behavior for invalid clipboard content, side effects, or prerequisites.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence of 10 words, directly conveys purpose with no unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a zero-parameter tool, description covers core purpose. Lacks output format or constraints, but adequate given simplicity.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Input schema has zero parameters, so schema coverage is 100%. Description adds no parameter info, but baseline for 0 params is 4.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states verb 'describe', resource 'UI in a clipboard screenshot', and aspects 'layout, components, state'. It distinguishes from sibling tools like 'describe_ui' (without clipboard) and 'analyze_clipboard'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Implicitly indicates use when clipboard holds a UI screenshot, but no explicit when-not-to-use or alternatives. Siblings exist but not referenced.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
diagnose_errorC
Diagnose an error screenshot file.
| Name | Required | Description | Default |
|---|---|---|---|
| image_path | Yes | Absolute path to the image file. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations, the description must disclose behavior. It only states 'diagnose' without indicating side effects (e.g., read-only), required permissions, or output format. This is insufficient for safe invocation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, front-loaded sentence with no redundancy. However, it could include more context without sacrificing conciseness.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with one parameter and no output schema, the description lacks details on what 'diagnose' returns (e.g., error analysis, possible fix). It feels incomplete as an instruction.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 100% and the description adds no additional meaning beyond the schema's 'Absolute path to the image file.' Baseline score applies.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action (diagnose) and the resource (error screenshot file). It is distinct from sibling tools like 'diagnose_error_from_clipboard' which uses clipboard input, so purpose is clear but could specify what 'diagnose' entails.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool vs alternatives such as 'diagnose_error_from_clipboard' or 'analyze_image'. The agent must infer from the parameter type.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
diagnose_error_from_clipboardB
Diagnose an error screenshot from the clipboard and propose fixes.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Lacks annotations. Description only says it diagnoses and proposes fixes, but does not disclose how it processes the clipboard (e.g., reads image, text), what types of errors, or any side effects.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence conveying essential purpose clearly. No wasted words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Simple tool but no annotations or output schema. For a diagnostic tool that proposes fixes, more detail on return format or error scope would improve completeness.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
No parameters, so schema coverage is 100%. The description does not need to explain parameters, but it could hint that the input is read automatically from clipboard.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Clearly states it diagnoses error screenshots from clipboard and proposes fixes. However, the sibling 'diagnose_error' likely performs similar analysis but without clipboard, and the description does not differentiate.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance on when to use this tool versus alternatives like 'diagnose_error' or other clipboard analysis tools. Implied usage when clipboard has an error screenshot, but no explicit context.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
extract_textC
OCR an image file.
| Name | Required | Description | Default |
|---|---|---|---|
| image_path | Yes | Absolute path to the image file. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description simply states 'OCR an image file' without disclosing behavioral traits such as supported image formats, file size limits, performance characteristics, or error handling. Since no annotations are provided, the description carries the full burden but adds minimal behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise at four words, front-loading the core purpose. However, it could be improved by including a brief sentence on usage or output. Still, it avoids verbosity and earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (one parameter, no output schema), the description could provide minimal context about the output (e.g., extracted text) or common use cases. The current description lacks completeness, leaving the agent unaware of what the tool returns or any constraints.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% coverage (the 'image_path' parameter is described as 'Absolute path to the image file.'). The description does not add any extra semantic value beyond the schema, but the schema itself is sufficient. According to the guidelines, high schema coverage sets a baseline of 3.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Describes the tool as 'OCR an image file,' which clearly indicates the specific operation (OCR) and the resource (image file). However, it does not differentiate from siblings like 'extract_text_from_clipboard' or 'analyze_image,' which could cause confusion about which tool to use.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No usage context is provided. The description does not specify when to use this file-based tool versus clipboard alternatives, nor does it mention any prerequisites (e.g., valid image format) or conditions for effective use.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
extract_text_from_clipboardA
OCR the image currently in the clipboard and return only its text.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations provided, so description must convey all behavioral details. It only states the core function, omitting what happens if no image, OCR failure, or output format. For a tool with no annotations, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
A single sentence efficiently conveys the full purpose with no redundancy. Every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given no parameters or output schema, the description is largely complete. It explains input (clipboard image) and output (text). However, lacks details on error cases or prerequisites, which would be helpful for a standalone tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The tool has zero parameters with 100% schema coverage, so baseline is 4. The description adds no parameter info but is unnecessary. It clearly conveys that the clipboard image is the implicit input.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool performs OCR on the clipboard image and returns text. The verb 'OCR' and resource 'image in clipboard' are specific, distinguishing it from siblings like 'extract_text' or 'code_from_clipboard'.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Usage is implied (when you have an image with text in clipboard), but lacks explicit when-not-to-use or alternatives. No mention of alternatives like 'extract_text' for other sources or 'analyze_clipboard' for different analysis.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
understand_diagramC
Interpret a diagram image file.
| Name | Required | Description | Default |
|---|---|---|---|
| image_path | Yes | Absolute path to the image file. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description must fully convey behavioral traits. It only states 'interpret,' offering no information about side effects, required permissions, or output nature. This is severely insufficient for safe invocation.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, efficient but under-specified. It lacks crucial details that would warrant a longer description, so it is not excessively verbose, but its brevity compromises completeness. A 3 reflects adequate conciseness with room for improvement.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's simplicity (one parameter, no output schema) and the presence of similar siblings, the description fails to provide enough context for correct usage. It omits return behavior, typical use cases, and differentiation from closely related tools, making it incomplete.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema description covers the single parameter 'image_path' at 100%, but the tool description adds no additional context about accepted formats, file size limits, or path conventions. With high schema coverage, a baseline of 3 is appropriate as the description provides no extra value beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description specifies 'interpret a diagram image file,' which narrows the scope to diagrams, distinguishing it from siblings like analyze_chart or analyze_image. However, 'interpret' is vague and does not clarify the tool's exact function, such as extracting text, recognizing shapes, or providing a semantic summary.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no usage guidance, such as when to use this tool versus alternatives like analyze_chart or analyze_image. It does not mention prerequisites, context, or when not to use it, leaving the agent to infer from sibling names alone.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
12 tool updates
v0.1.0- First observed
analyze_chart - First observed
analyze_clipboard - First observed
analyze_image - First observed
code_from_clipboard - First observed
code_from_screenshot - First observed
describe_ui - First observed
describe_ui_from_clipboard - First observed
diagnose_error - First observed
diagnose_error_from_clipboard - First observed
extract_text - First observed
extract_text_from_clipboard - First observed
understand_diagram
TDQS
Scored across 12 tools
Tools are mostly distinct, but analyze_clipboard (general clipboard analyzer) overlaps with specialized clipboard tools like code_from_clipboard and describe_ui_from_clipboard, potentially confusing an agent about which to use for a broad request.
All tool names follow a consistent verb_noun snake_case pattern (e.g., analyze_chart, extract_text, describe_ui_from_clipboard), with predictable suffixes for clipboard variants.
12 tools is a well-scoped count for an image analysis server covering both file and clipboard inputs for common specialized tasks (text, code, UI, errors, diagrams) plus general analysis.
The set covers most common image analysis needs, but lacks clipboard-specific tools for chart and diagram analysis (only file versions exist), leaving a minor gap that the general analyze_clipboard can fill but with less specificity.
Maintenance
Related MCP Connectors
OCR, transcription, file extraction, and image generation for AI agents via MCP.
Generate AI images, videos, music, SFX & speech in any AI assistant. Results appear inline in chat.
Image & PDF tools for AI agents: compress, convert, resize, PDF, AI vision, pipeline.
Generate images with your own ChatGPT subscription (Plus, Pro or Team), without spending API credits
Related MCP Servers
- AlicenseAqualityDmaintenanceGives vision-less LLMs the ability to recognize clipboard screenshots and images by proxying to an OpenAI-compatible vision model.115 npm2MIT
- FlicenseAqualityDmaintenanceProvides image understanding capabilities to coding models without vision support by automatically invoking a vision model and returning text descriptions, enabling seamless context-aware coding with images.12-
- AlicenseAqualityAmaintenanceGives text-only LLM coding agents vision by routing images to a multimodal model and returning detailed textual descriptions. Supports local files, URLs, clipboard, base64, raw bytes, and multiple providers like OpenAI, Anthropic, and Gemini.198 npm12MIT
- AlicenseNot gradedqualityBmaintenanceEnables text-only models to understand images by intercepting pasted images, saving them locally, and using a vision MCP server to analyze them with multimodal backends like Qwen-VL, Doubao, or GLM-4V.1MIT