qwen-omni-mcp

An MCP server that gives Claude Code and other AI agents video and image understanding via Bailian (DashScope) using the multimodal Qwen3.7-Plus model.

Qwen3.7-Plus reads video natively — no client-side frame extraction. You pass a public media URL; the model does the rest.

Highlights

• Native video understanding — send a video URL, get grounded analysis

• Image understanding — describe, Q&A, OCR

• Convenience tools — summarize, text extraction, frame comparison, Q&A

• npx-launchable — one line in your MCP client config

• Hardened — secret-leak pre-commit guard + gitleaks, strict TypeScript, full CI

Related MCP server: Qwen Video Understanding MCP Server

Install

No global install needed. Run directly with npx:

npx -y qwen-omni-mcp

For local development:

git clone <this-repo>
cd qwen-omni-mcp
npm install            # also installs husky git hooks
cp .env.example .env   # fill in DASHSCOPE_API_KEY
npm run dev            # run from source via tsx

Configuration

All config is via environment variables (loaded from .env by dotenv):

Get a key at https://platform.qianwenai.com/home/api-keys.

The Anthropic-compatible /apps/anthropic endpoint does not support video input, so this server uses the OpenAI-compatible endpoint.

Use with Claude Code

Add to your MCP client config:

{
  "mcpServers": {
    "qwen-omni-mcp": {
      "command": "npx",
      "args": ["-y", "qwen-omni-mcp"],
      "env": {
        "DASHSCOPE_API_KEY": "your-key"
      }
    }
  }
}

For local development without publishing:

{
  "mcpServers": {
    "qwen-omni-mcp": {
      "command": "npx",
      "args": ["tsx", "src/index.ts"],
      "env": { "DASHSCOPE_API_KEY": "your-key" }
    }
  }
}

Tools

Media must be reachable via a public http/https URL. Large local videos should be hosted at a public URL (base64 data URLs over ~10MB will be rejected).

Development

npm run typecheck     # strict tsc
npm run lint          # eslint, --max-warnings 0
npm run format:check  # prettier
npm test              # unit + mocked e2e (no API cost)
npm run build         # emit dist/
LIVE=1 npm run test:live   # real API calls (costs tokens)

CI (.github/workflows/ci.yml) runs the same gates on Node 20/22. secrets-scan.yml runs gitleaks. smoke-live.yml (manual / weekly) runs one real image call.

See AGENTS.md for the full set of agent rules (never bypass hooks, never commit secrets, etc.).

License

MIT