multimodal-mcp
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@multimodal-mcpDescribe the screenshot at /Users/me/screenshot.png"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
multimodal-mcp
为 Codex(DeepSeek 等纯文本模型)补上多模态能力的本地 MCP server,提供 10 个工具:
工具 | 功能 | 依赖 |
| 看图并返回文字描述 | 智谱 GLM-4V-Flash(免费) |
| 本地 Whisper 转写音频 | faster-whisper(首次使用联网下载模型) |
| 抽帧分析视频 + 音轨转写 | GLM-4V-Flash + faster-whisper |
| 文生图并保存 PNG | 智谱 CogView-3-Flash(免费) |
| 提交视频生成任务,返回任务 ID | 智谱 CogVideoX-Flash(免费) |
| 查询视频任务结果,成功后下载 MP4 | 智谱 CogVideoX-Flash(免费) |
| 小说→漫剧剧本 JSON(角色卡+分镜) | 智谱 GLM-4.7-Flash(免费) |
| 后台逐镜生成:出图→动画→配音 | CogView-3-Flash + CogVideoX-Flash + edge-tts |
| 查询漫剧进度,完成后返回成片 | 同上 |
| 文字合成 MP3 语音 | edge-tts(免费) |
适用环境
开发与验证环境:macOS(Apple Silicon,Python 3.14,Codex CLI 0.146)。
一键安装脚本支持:macOS / Linux(bash)。Windows 暂不支持脚本安装,可手动安装(见下文)。
一键安装不限于新电脑:任何已装好 Codex 的电脑都可以运行;现有电脑第一次运行 = 安装,之后重复运行 = 升级。
Related MCP server: DeepSeek Eyes
前置要求
Codex(桌面应用)或 Codex CLI:必须先安装,一键脚本才能自动注册 MCP server。安装方式见 Codex 官方文档:https://developers.openai.com/codex
git:
brew install git(macOS)或系统包管理器安装。Python 3.11+:macOS 推荐
brew install python@3.12。智谱 API key(可选,安装时可输入):到 https://bigmodel.cn 注册,
GLM-4V-Flash(看图)、CogView-3-Flash(文生图)、CogVideoX-Flash(文生视频)均为免费档。
一键安装 / 升级(推荐)
在终端执行一条命令:
bash <(curl -fsSL https://raw.githubusercontent.com/LinJianKun/multimodal-mcp/master/scripts/install.sh)脚本全自动完成以下所有步骤,无需再手动执行任何安装或注册命令:
克隆仓库到
~/multimodal-mcp(已存在则自动git pull升级);创建
.venv虚拟环境并安装全部依赖(mcp、faster-whisper、edge-tts、ffmpeg 等);生成
.env配置并提示输入智谱 key(也可以用ZHIPU_API_KEY=xxx环境变量免交互);自动注册 Codex MCP server:
codex mcp add multimodal -- <安装目录>/.venv/bin/multimodal-mcp(已注册且路径一致则跳过,路径不同自动重新注册);自动修复
~/.codex/models.json的supports_search_tool(先备份再修改,解决 DeepSeek 配置下 MCP 工具不可见的问题);输出完成提示与下一步操作。
重复运行 = 升级:自动拉取最新代码并重装依赖,不会覆盖已有 .env。
可选环境变量:
变量 | 作用 | 默认值 |
| 安装目录 |
|
| 免交互提供智谱 key | 无(否则交互输入) |
| 跳过 Codex 注册(调试/无 codex 时) | 不跳过 |
| 指定 models.json 路径 |
|
安装完成后:
完全退出并重启 Codex(macOS 用 Cmd+Q,不是关窗口);
新会话输入
/mcp,确认multimodal已连接;让 Codex 执行“分析
/Users/<你的用户名>/multimodal-mcp/evaluations/samples/red.png”验证看图功能。
手动安装(可选,适合开发/审查代码时)
不想用一键脚本时,可以手动执行等价步骤:
git clone https://github.com/LinJianKun/multimodal-mcp.git
cd multimodal-mcp
python3 -m venv .venv
.venv/bin/pip install -e ".[dev]"
cp .env.example .env
# 编辑 .env,填入 ZHIPU_API_KEY
codex mcp add multimodal -- "$(pwd)/.venv/bin/multimodal-mcp"
# 手动修复 ~/.codex/models.json:把所有模型的 supports_search_tool 改为 false(先备份)使用示例
“分析 /path/to/screenshot.png,这是什么报错?”
“转写 /path/to/meeting.m4a,总结要点”
“分析 /path/to/demo.mp4 的前 6 帧,说明界面变化”
“生成一张赛博朋克风格的城市夜景图”
“生成一段 5 秒的猫咪玩球视频”
“把 /path/to/novel.txt 改编成漫剧并生成视频”
“把‘你好,欢迎使用’合成为语音”
漫剧制作(小说→成片)
三步完成一部 AI 漫剧:
mm_create_comic_script(novel_path):上传 .txt/.md 小说,自动生成剧本 JSON(角色卡 + 分镜)。长篇小说按 5000 字分章、摘要递进,支持 UTF-8 与 GBK 编码。剧本会保存到outputs/comic/<小说名>/script.json,可先人工审阅/修改再开拍;mm_start_comic_video(script_path, size="1024x1024"):后台逐镜执行 出图(CogView-3-Flash)→ 图生视频(CogVideoX-Flash)→ 多角色配音(edge-tts),限流自动退避重试,每镜产物缓存、支持断点续跑(resume_job_id);mm_query_comic_video(job_id):查询进度,全部完成后自动合成 1080x1920 竖屏成片(含字幕),返回 MP4 路径。
默认一集 30 镜 × 5 秒 ≈ 2.5 分钟;快模式(1024x1024)一集约 1-2 小时,原生竖屏模式(1080x1920)约 6 小时+。免费档高峰限流较多,Job 在后台自动排队重试,可随时查询进度。
视频生成(异步两步式)
视频生成需要几分钟,MCP 工具单次调用有超时限制,因此拆成两个工具:
mm_generate_video(prompt, duration=5, size="1920x1080", fps=30, with_audio=false):提交任务,返回任务 ID;mm_query_video_task(task_id):反复查询直到SUCCESS,成功后自动下载 MP4 到outputs/videos/并返回路径。
期间任务状态为 PROCESSING(生成中),可让模型每隔一段时间再次调用查询工具。
测试
.venv/bin/pytest -v限制
DeepSeek 得到的是工具返回的文字,精确读图不如原生多模态模型。
智谱免费模型有速率限制;edge-tts 依赖微软在线服务,偶发不可用。
Whisper 首次转写需联网下载模型(默认 small)。
一键安装脚本仅支持 macOS / Linux;Windows 请走手动安装流程。
Available Tools
10 toolsmm_analyze_videoARead-onlyIdempotent
抽帧分析视频,并可结合音轨转写。
Args: video_path: 本地视频绝对路径,支持 MP4/MOV/MKV/WEBM。 max_frames: 均匀抽取的帧数,1-20,默认 6。 include_audio: 是否同时转写音轨,默认 true。 question: 可选,分析关注点。
Returns: str: Markdown 格式的场景摘要(帧时间线 + 音轨转写)。
| Name | Required | Description | Default |
|---|---|---|---|
| question | No | ||
| max_frames | No | ||
| video_path | Yes | ||
| include_audio | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare read-only and idempotent behavior. The description adds meaningful context about the return format (Markdown scene summary), the uniform frame extraction behavior, and the default to include audio transcription, which goes beyond basic safety annotations. No contradiction found.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise: one-sentence summary followed by a structured list of arguments and return value. Every sentence and field adds value, with no redundancy or filler.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity and the schema lacking param descriptions, the description covers all parameters, return format, and core behavior. It does not mention time/resource limitations (e.g., video size limits), but annotations cover safety aspects, so the overall context is sufficient for an agent to invoke the tool correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, but the Args section fully documents each parameter: video_path (local absolute path, supported formats), max_frames (range 1-20, default 6), include_audio (default true), and question (optional focus). This completely compensates for the missing schema descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
Description clearly states it extracts frames from video and optionally transcribes audio, distinguishing it from sibling tools like mm_describe_image (single image) and mm_transcribe_audio (audio-only). The verb '分析视频' (analyze video) with specific resources and capabilities makes the purpose unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Usage context is implied: it's for video analysis with frame extraction and optional audio transcription. However, it does not explicitly mention when to use this tool instead of alternatives (e.g., audio-only tasks should use mm_transcribe_audio), nor does it mention exclusions or prerequisites.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_create_comic_scriptA
上传一部小说,自动生成漫剧剧本 JSON(角色卡 + 分镜)。
Args: novel_path: 本地小说文件绝对路径,支持 .txt/.md(UTF-8 或 GBK)。 style: 画风描述,默认日系动漫。 max_scenes: 分镜数量,1-50,默认 30。
Returns: str: 剧本 JSON 绝对路径与角色/分镜摘要,可人工编辑后再开拍。
| Name | Required | Description | Default |
|---|---|---|---|
| style | No | 日系动漫 | |
| max_scenes | No | ||
| novel_path | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already provide readOnlyHint=false and destructiveHint=false, and the description adds meaningful context: supported file formats (.txt/.md with UTF-8/GBK), parameter ranges (max_scenes 1-50), and that the output is an editable JSON script. It does not contradict annotations and clarifies the tool's generative, non-destructive nature.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is well-structured with a clear opening purpose, an Args section, and a Returns section. Every sentence provides useful information without redundancy, making it efficient and easy to scan.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (novel-to-script generation), the description covers all key aspects: inputs, parameter constraints, output format, and editability. It lacks details on potential errors, processing time, or side effects, but these are adequately implied by annotations and the presence of an output schema.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Despite 0% schema description coverage, the description fully documents each parameter: novel_path (absolute path with supported extensions and encodings), style (default 日系动漫), and max_scenes (range and default). This adds significant meaning beyond the schema's bare types and defaults.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function with a specific verb and resource: '上传一部小说,自动生成漫剧剧本 JSON' (upload a novel, auto-generate comic script JSON), and specifies the output includes character cards and storyboards. This distinguishes it from siblings like mm_generate_image or mm_start_comic_video, which handle different media generation stages.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage context (adapting a novel into a script for comic video production) but does not explicitly state when to use this tool versus alternatives like mm_generate_image or mm_start_comic_video. There are no explicit exclusions or alternative references, so the guidance remains implied rather than direct.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_describe_imageARead-onlyIdempotent
分析本地图片并返回文字描述。
Args: image_path: 本地图片绝对路径,支持 PNG/JPEG/WebP/GIF。 prompt: 可选,指定关注点,例如“这是什么报错信息?”。
Returns: str: 图片内容描述(Markdown 文本)。
| Name | Required | Description | Default |
|---|---|---|---|
| prompt | No | ||
| image_path | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already cover read-only safety (readOnlyHint, idempotentHint, destructiveHint). The description adds valuable behavioral context beyond annotations, such as input format restrictions and the return type (Markdown text), which is useful for the agent.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise and well-structured with clear sections (summary, Args, Returns). Every sentence adds value, and the main purpose is front-loaded, making it easy for the agent to parse.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the low complexity (2 simple params) and existing output schema, the description is complete: it includes purpose, parameter semantics, return type, and input constraints. No critical information is missing for correct invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, making the description's Args section essential. It explains image_path with absolute path and supported formats, and prompt as optional with a concrete example, fully compensating for the lack of schema descriptions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool analyzes local images and returns text descriptions, using a specific verb+resource+output structure. It distinguishes itself from sibling tools by specifying 'image' as the media type, differentiating from audio/video tools.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides clear context on when to use the tool by specifying it works with local image paths and supported formats (PNG/JPEG/WebP/GIF). It implies exclusions (e.g., remote URLs, unsupported formats) but does not explicitly name alternatives or when-not-to-use conditions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_generate_imageA
根据文字提示生成图片并保存。
Args: prompt: 图片内容描述。 size: 画幅,支持 1024x1024 / 768x1344 / 1344x768。 output_path: 可选保存路径(默认 outputs/images/)。
Returns: str: 生成的图片文件绝对路径。
| Name | Required | Description | Default |
|---|---|---|---|
| size | No | 1024x1024 | |
| prompt | Yes | ||
| output_path | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description adds useful behavioral details beyond annotations: it specifies saving to output_path (defaulting to outputs/images/), lists supported sizes, and returns an absolute path. It aligns with readOnlyHint=false without contradiction.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise and well-structured: a one-sentence summary followed by Args and Returns sections. No unnecessary information or repetition.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers all parameters, defaults, and the return type, which is sufficient for a simple image-generation tool. It could mention error behavior or file-overwrite details, but these are not critical for basic invocation.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage, the description fully explains each parameter: prompt (image content), size (supported formats), and output_path (optional, default). This provides necessary meaning beyond the raw schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool generates and saves an image from a text prompt, distinguishing it from sibling tools like mm_generate_video and mm_describe_image.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
Usage is implied from the purpose, but there is no explicit guidance on when to use this tool versus alternatives, nor any exclusions or conditions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_generate_videoA
提交视频生成任务(异步),返回任务 ID 供 mm_query_video_task 查询。
Args: prompt: 视频内容描述,最多 512 字符。 duration: 视频时长秒数,5 或 10,默认 5。 size: 分辨率,支持 1280x720 / 720x1280 / 1024x1024 / 1920x1080 / 1080x1920 / 2048x1080 / 3840x2160。 fps: 帧率,30 或 60,默认 30。 with_audio: 是否生成 AI 音效,默认 false。
Returns: str: 任务 ID,生成可能需要几分钟,请反复调用 mm_query_video_task 查询。
| Name | Required | Description | Default |
|---|---|---|---|
| fps | No | ||
| size | No | 1920x1080 | |
| prompt | Yes | ||
| duration | No | ||
| with_audio | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Beyond annotations (readOnlyHint=false, destructiveHint=false), the description discloses that the operation is asynchronous, returns a task ID, takes several minutes, and requires polling via mm_query_video_task. This provides rich behavioral context that annotations alone do not cover.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is well-structured with a one-line summary, a clear Args list, and a Returns note. Every element earns its place, and there is no redundant or filler content.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a tool with 5 parameters, async behavior, and a follow-up workflow, the description covers inputs, return value, and next steps. It even specifies the likely return type (task ID) and generation time, making it a complete standalone reference.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has no property descriptions (0% coverage), but the description's Args section gives detailed semantics for all 5 parameters, including constraints (prompt max 512 chars, duration choices 5/10, allowed resolutions, fps choices 30/60, with_audio default false). This fully compensates for the schema gap.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states it submits an asynchronous video generation task and returns a task ID for polling with mm_query_video_task. It uses a specific verb ('提交' / submit) and resource (video generation), and distinguishes from sibling tools that handle other media or query tasks.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
It explicitly explains the asynchronous workflow and directs the user to mm_query_video_task for querying results, giving clear follow-up guidance. However, it does not explicitly contrast with alternative generation tools like mm_generate_image, so the when-not-to-use aspect is implied rather than explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_query_comic_videoARead-onlyIdempotent
查询漫剧生产任务进度;完成后返回成片路径。
Args: job_id: mm_start_comic_video 返回的任务 ID。
Returns: str: 进度信息或最终视频路径。
| Name | Required | Description | Default |
|---|---|---|---|
| job_id | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true, destructiveHint=false, and idempotentHint=true, covering the safety profile. The description adds return behavior (progress vs. final path), but since an output schema exists, this is partially redundant. No contradiction with annotations.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise with three clear sections: purpose, Args, and Returns. Every sentence earns its place, and the front-loaded purpose sentence immediately conveys what the tool does. No unnecessary words.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple query tool with one parameter and an output schema, the description adequately covers the operation, input origin, and return type. It could mention explicit alternatives or when not to use, but the context signals (sibling tools) and naming make the specialization clear.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema coverage is 0%, but the description compensates by explaining that job_id is the ID returned by mm_start_comic_video. This adds meaningful semantics beyond the schema's bare 'Job Id' field, though more detail about format or constraints could be provided.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: querying comic production task progress and returning the final video path upon completion. The verb '查询' and resource '漫剧生产任务进度' are specific, and the reference to mm_start_comic_video distinguishes it from the generic sibling mm_query_video_task.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explains that job_id comes from mm_start_comic_video, providing clear context for when to use this tool (after starting a comic video task). It does not explicitly list alternatives or exclusions, but the context is sufficient for a focused query tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_query_video_taskAIdempotent
查询视频生成任务;成功后下载 MP4 到本地。
Args: task_id: mm_generate_video 返回的任务 ID。 output_path: 可选保存路径(默认 outputs/videos/)。
Returns: str: 任务仍处理中时返回当前状态;成功后返回视频文件路径。
| Name | Required | Description | Default |
|---|---|---|---|
| task_id | Yes | ||
| output_path | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses important side effects (downloading MP4 to local) and return behavior for both in-progress and success states, going beyond what annotations alone provide. It also mentions a default output path, adding useful context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise and well-structured, starting with a clear summary followed by Args and Returns sections. Every sentence serves a purpose without redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple 2-parameter tool, the description covers the essentials: purpose, parameter semantics, and return value behavior. It lacks detailed error handling or explicit alternative exclusions, but the provided info is sufficient for normal agent use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Despite 0% schema coverage, the description explains both parameters thoroughly: task_id comes from mm_generate_video control flow, and output_path has a default with optional saving. This fully compensates for the bare input schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool queries a video generation task and downloads the MP4 file after success, using a task ID from mm_generate_video. This specificity differentiates it from siblings like mm_query_comic_video.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description explicitly ties task_id to mm_generate_video, giving clear context on when to use this tool. It doesn't explicitly exclude alternatives, but the source of the task ID and the tool's name make its purpose clear enough for an agent.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_start_comic_videoA
根据剧本 JSON 启动漫剧生产任务(后台逐镜生成)。
Args: script_path: mm_create_comic_script 生成的剧本 JSON 绝对路径。 size: 生成画幅,1024x1024(快,默认)或 1080x1920(竖屏慢)。 resume_job_id: 可选,恢复之前未完成的 job。
Returns: str: job_id,用 mm_query_comic_video 查询进度。
| Name | Required | Description | Default |
|---|---|---|---|
| size | No | 1024x1024 | |
| script_path | Yes | ||
| resume_job_id | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
The description discloses that the task runs in the background and generates shots sequentially, which is behavioral context beyond the annotations. It also explains that it returns a job_id for later status queries and that resume_job_id can resume unfinished jobs. These details complement the annotations' readOnlyHint=false and openWorldHint=true without contradiction.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is compact and well-structured: a one-sentence summary, followed by a clean Args list and a Returns line that points to the query tool. Each line adds value without redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the core workflow: input, options, output, and follow-up. It mentions the return type and the sibling tool for querying, and the background behavior. For a tool that starts an async job, this is sufficient context for an agent to select and invoke it correctly.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The description provides a full Args section with detailed explanations for all three parameters, including default values, trade-offs (fast vs slow size), and the origin of script_path (generated by mm_create_comic_script). Since the schema has 0% description coverage, this completely fills the gap.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description uses a specific verb '启动' (start) with a clear resource '漫剧生产任务' and specifies the input (script JSON) and mode (background shot-by-shot). This distinguishes it from sibling tools like mm_create_comic_script (which creates the script) and mm_query_comic_video (which queries progress).
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description clearly states the prerequisite (script JSON from mm_create_comic_script) and points the user to mm_query_comic_video for progress, establishing the tool's position in the workflow. It also explains resume_job_id for continuing incomplete jobs, providing context on when to resume. However, it doesn't explicitly mention when not to use this versus mm_generate_video, so it's not a full alternative comparison.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_synthesize_speechA
把文字合成为语音并保存为 MP3。
Args: text: 要朗读的文字,最多 1000 字符。 voice: 可选音色,默认 zh-CN-XiaoxiaoNeural。 output_path: 可选保存路径(默认 outputs/audio/)。
Returns: str: 生成的音频文件绝对路径。
| Name | Required | Description | Default |
|---|---|---|---|
| text | Yes | ||
| voice | No | ||
| output_path | No |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations indicate non-read-only and non-destructive behavior. The description adds that the tool saves to MP3 and returns an absolute path, which gives concrete side-effect information beyond the annotations. It does not contradict annotations and offers useful behavioral context.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a well-structured docstring with a concise purpose statement followed by Args and Returns sections. Every element serves a purpose, with no unnecessary wording. It is front-loaded with the core functionality.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the essential input parameters, defaults, and return type, making it sufficient for a simple TTS tool. Minor gaps remain, such as overwrite behavior and a list of supported voices, but the description is largely complete for typical use.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
With 0% schema description coverage, the description compensates by explaining each parameter: text (max 1000 chars), voice (default zh-CN-XiaoxiaoNeural), and output_path (default outputs/audio/). This adds practical meaning, though it leaves some ambiguity about whether output_path is a directory or full file path.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's function: '把文字合成为语音并保存为 MP3' (synthesize text into speech and save as MP3). This specifies a distinct action (synthesis) and output format, distinguishing it from sibling tools like mm_transcribe_audio (inverse task) and mm_generate_image/video.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides practical constraints (max 1000 characters) and defaults (voice, output path), which imply when to use the tool. However, it does not explicitly mention alternatives or when not to use it, leaving usage guidance implied rather than explicit.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
mm_transcribe_audioARead-onlyIdempotent
转写本地音频为文字。
Args: audio_path: 本地音频绝对路径,支持 MP3/WAV/M4A/FLAC/OGG。 language: 可选 ISO 639-1 语言代码,如 zh、en;默认自动检测。
Returns: str: Markdown 格式的转写结果(语言、全文、分段)。
| Name | Required | Description | Default |
|---|---|---|---|
| language | No | ||
| audio_path | Yes |
Output Schema
| Name | Required | Description |
|---|---|---|
| result | Yes |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Annotations already declare readOnlyHint=true, idempotentHint=true, and destructiveHint=false, covering the safety profile. The description adds valuable behavioral context: it requires a local absolute path (not a URL), supports specific formats, defaults language auto-detection, and returns a Markdown structure with language, full text, and segments. This goes beyond what annotations provide.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is compact and well-structured. The purpose is front-loaded in one sentence, followed by concise Args and Returns sections. Every sentence adds value—no filler, no repetition of the tool name or title.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
The description covers the essential aspects for a transcription tool: input format, supported extensions, optional language parameter, and return format. Combined with annotations (read-only, idempotent) and the low parameter count, the description is complete and leaves no major gaps for an agent to misuse the tool.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 0%, but the description fully compensates. It explains audio_path requires an absolute local path and lists supported formats. It explains language is optional ISO 639-1 (e.g., zh, en) and defaults to auto-detection. Every parameter is meaningfully described beyond the raw schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description opens with '转写本地音频为文字' (transcribe local audio to text), a specific verb+resource statement. This clearly distinguishes the tool from siblings like mm_synthesize_speech (speech generation) and mm_analyze_video (video analysis), making its purpose unambiguous.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage context by specifying 'local audio' and listing supported formats (MP3/WAV/M4A/FLAC/OGG). It does not explicitly name alternatives or exclusion criteria, but the sibling list shows no overlap, so clear context suffices. A stronger statement like 'use this instead of mm_synthesize_speech when transcribing' would earn a 5.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
TDQS
Each tool targets a distinct medium or pipeline stage: image/audio/video analysis, image/video/speech generation, and video/comic task queries. Even the two query tools are clearly separated by resource (video_task vs comic_video), so there is no ambiguity.
All tools follow a consistent mm_ prefix with snake_case verb_noun naming (describe_image, transcribe_audio, generate_video, create_comic_script, etc.). The verb choices accurately reflect the action, and no mixed conventions exist.
10 tools is well-scoped for a multimodal MCP server, covering analysis and generation across image, audio, video, and a specialized comic pipeline. Each tool earns its place without redundancy or bloat.
The tool surface covers full lifecycles: video generation has submit and query, comic creation has script generation, start, and query, and all input types (image, audio, video) have analysis tools. No obvious dead ends or missing core operations for the stated purpose.
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Connectors
MCP server for Qwen Image 3 AI image generation
OCR, transcription, file extraction, and image generation for AI agents via MCP.
MCP server for Google Veo AI video generation
MCP server for Grok Imagine AI video generation
Related MCP Servers
- FlicenseNot gradedqualityBmaintenanceA versatile MCP server that adds vision capabilities (image analysis, OCR, image/video generation) to AI models lacking native vision, with support for multiple providers and automatic task routing.1
- AlicenseAqualityCmaintenanceAn MCP server that grants image recognition to text-only models like DeepSeek by forwarding images to vision models and returning text descriptions. Supports clipboard, pasted session images, and batch folder image recognition.53MIT
- AlicenseNot gradedqualityBmaintenanceMCP server that gives text-only LLMs vision capabilities by using a free multimodal model to perceive images, audio, and video, returning text for the main model to reason with.632MIT
- AlicenseNot gradedqualityCmaintenanceMCP server that gives text-only agents like Claude Code and Codex image, video, and audio analysis capabilities through local setup and multiple AI providers.MIT
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/LinJianKun/multimodal-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server