Skip to main content
Glama

analyze_image

Analyze local screenshots with an image path and prompt to get text descriptions or structured JSON for inspecting UI layouts, error messages, and element coordinates in UI automation.

Instructions

分析本地图片(UI 自动化视觉辅助)。

当需要"查看屏幕/截图/界面"时使用:传入截图路径与问题,返回多模态模型的文字描述或结构化 JSON。

调用规范(必须遵守):

  • 调用前,先在回复中说明你正在分析哪张截图及其目的(如"让我分析一下当前界面")。

  • prompt 必须写明具体想知道的描述内容,例如 "描述界面布局并列出所有可见按钮"、"截图中有哪些错误提示"、"这个弹窗的标题和选项是什么"。

  • 禁止传空 prompt 或含糊 prompt(如 "看一下"、"描述" ),server 会把过短的 prompt 视为无效并自动补充标准描述要求。

  • 图片必须已保存为本地文件,传入绝对路径;本工具自行读取,无需传图片内容。

  • 需要结构化结果(如元素坐标)时设置 json_mode=true,要求模型返回 JSON。

Input Schema

TableJSON Schema
NameRequiredDescriptionDefault
promptYes要问的问题,如"描述界面并列出可见按钮"
json_modeNo为 true 时要求模型返回 JSON(用于结构化结果,如坐标)
image_pathYes本地图片文件的绝对路径(如 /tmp/screenshot.png)
Behavior5/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Despite no annotations, the disclosure is strong: it warns about invalid short prompts, states the tool reads the image itself from a local path, and explains the meaning of json_mode for structured output. This goes well beyond the schema and gives the agent clear behavioral expectations.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is well-organized with a clear lead sentence followed by concise bullet-like rules, every sentence contributing value. It avoids redundancy and remains focused, making it easy to parse and apply.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple 3-parameter tool with no output schema, the description fully covers prerequisites, call conventions, return format, and parameter behavior. It addresses all necessary context an agent would need to invoke the tool correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the baseline is 3. The description adds meaningful semantics by emphasizing that prompt must be specific (and that short prompts are auto-supplemented), requiring absolute paths, and clarifying that json_mode enables structured JSON results. This elevates the parameter understanding beyond the schema descriptions.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool analyzes local images for UI automation visual assistance, using the specific verb-resource pair '分析本地图片' and explicitly mentions its return type (text or structured JSON). It also specifies the use case ('当需要查看屏幕/截图/界面时使用'), making the purpose unmistakable.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides explicit context for when to use the tool ('当需要查看屏幕/截图/界面时') and includes detailed call requirements (such as announcing the screenshot before calling and using a specific prompt). It does not mention alternatives or exclusions, but with no sibling tools specified, this is acceptable.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Install Server

Other Tools

Latest Blog Posts

MCP directory API

We provide all the information about MCP servers via our MCP API.

curl -X GET 'https://glama.ai/api/mcp/v1/servers/KOG123/visual-intelligence-mcp'

If you have feedback or need assistance with the MCP directory API, please join our Discord server