DINO-X Image Detection MCP Server

DINO-X MCP

English | 中文

Enables large language models to perform fine-grained object detection and image understanding, powered by DINO-X and Grounding DINO 1.6 API.

💡 Why DINO-X MCP?

Although multimodal models can understand and describe images, they often lack precise localization and high-quality structured outputs for visual content.

With DINO-X MCP, you can:

🧠 Achieve fine-grained image understanding — both full-scene recognition and targeted detection based on natural language.

🎯 Accurately obtain object count, position, and attributes, enabling tasks such as visual question answering.

🧩 Integrate with other MCP Servers to build multi-step visual workflows.

🛠️ Build natural language-driven visual agents for real-world automation scenarios.

🎬 Use Case

🎯 Scenario	📝 Input	✨ Output
Detection & Localization	💬 Prompt:`Detect and visualize the` `fire areas in the forest` 🖼️ Input Image:
Object Counting	💬 Prompt:`Please analyze thiswarehouse image, detectall the cardboard boxes,count the total number`🖼️ Input Image:
Feature Detection	💬 Prompt:`Find all red carsin the image`🖼️ Input Image:
Attribute Reasoning	💬 Prompt:`Find the tallest personin the image, describetheir clothing`🖼️ Input Image:
Full Scene Detection	💬 Prompt:`Find the fruit withthe highest vitamin Ccontent in the image`🖼️ Input Image:	Answer: Kiwi fruit (93mg/100g)
Pose Analysis	💬 Prompt:`Please analyze whatyoga pose this is`🖼️ Input Image:

🚀 Quick Start

1. Prerequisites

You can install Node.js using one of the following methods:

Option A: Command 👍

# For MacOS or Linux
# 1. Install nvm (Node Version Manager)
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.1/install.sh | bash
# OR
wget -qO- https://raw.githubusercontent.com/nvm-sh/nvm/v0.40.1/install.sh | bash

# 2. Add these lines to your profile (~/.bash_profile, ~/.zshrc, ~/.profile, or ~/.bashrc)
export NVM_DIR="$HOME/.nvm"
[ -s "$NVM_DIR/nvm.sh" ] && \. "$NVM_DIR/nvm.sh"  
[ -s "$NVM_DIR/bash_completion" ] && \. "$NVM_DIR/bash_completion"  

# 3. Activate nvm in current shell
source ~/.bashrc
# Or
source ~/.zshrc   

# 4. Verify nvm installation
command -v nvm

# 5. Install and use LTS version of Node.js
nvm install --lts
nvm use --lts

# For Windows
winget install OpenJS.NodeJS.LTS
# Or using PowerShell (Administrator)
iwr -useb https://raw.githubusercontent.com/chocolatey/chocolatey/master/chocolateyInstall/InstallChocolatey.ps1 | iex
choco install nodejs-lts -y

Option B: Manual Installation

Download the installer from nodejs.org

Also, choose an AI assistants and applications that support the MCP Client, including but not limited to:

2. Configure MCP Sever

You can use DINO-X MCP server in two ways:

Option A: Using NPM Package 👍

Add the following configuration in your MCP client:

{
  "mcpServers": {
    "dinox-mcp": {
      "command": "npx",
      "args": ["-y", "@deepdataspace/dinox-mcp"],
      "env": {
        "DINOX_API_KEY": "your-api-key-here",
        "IMAGE_STORAGE_DIRECTORY": "/path/to/your/image/directory"
      }
    }
  }
}

Option B: Using Local Project

First, clone and build the project:

# Clone the project
git clone https://github.com/IDEA-Research/DINO-X-MCP.git
cd DINO-X-MCP

# Install dependencies
pnpm install

# Build the project
pnpm run build

Then configure your MCP client:

{
  "mcpServers": {
    "dinox-mcp": {
      "command": "node",
      "args": ["/path/to/DINO-X-MCP/build/index.js"],
      "env": {
        "DINOX_API_KEY": "your-api-key-here",
        "IMAGE_STORAGE_DIRECTORY": "/path/to/your/image/directory"
      }
    }
  }
}

3. Get API Key

Get your API key from DINO-X Platform (A free quota is available for new users).

Replace your-api-key-here in the configuration above with your actual API key.

4. Environment Variables

The DINO-X MCP server supports the following environment variables:

Variable Name	Description	Required	Default Value	Example
`DINOX_API_KEY`	Your DINO-X API key for authentication	Required	-	`your-api-key-here`
`IMAGE_STORAGE_DIRECTORY`	Directory where generated visualization images will be saved	Optional	macOS/Linux: `/tmp/dinox-mcp`Windows: `%TEMP%\dinox-mcp`	`/Users/admin/Downloads/dinox-images`

5. Available Tools

Restart your MCP client, and you should be able to use the following tools:

Method Name	Description	Input	Output
`detect-all-objects`	Detects and localizes all recognizable objects in an image.	Image	Category names + bounding boxes + captions
`object-detection-by-text`	Detects and localizes objects in an image based on a natural language prompt.	Image + Text prompt	Bounding boxes + object captions
`detect-human-pose-keypoints`	Detects 17 human body keypoints per person in an image for pose estimation.	Image	Keypoint coordinates and captions
`visualize-detections`	Visualizes detection results by drawing bounding boxes and labels on the image.	Image + Detection results	Annotated image saved to storage directory

📝 Usage

Supported Image Formats

Remote URLs starting with https:// 👍
Local file paths (starting with file://)
Common image formats: jpg, jpeg, png, webp

API Docs

Please refer to DINO-X Platform for API usage limits and pricing information.

🛠️ Development

Watch Mode

During development, you can use watch mode for automatic rebuilding:

pnpm run watch

Debugging

Use MCP Inspector to debug the server:

pnpm run inspector

License

Apache License 2.0

This server cannot be installed

security - not tested

license - permissive license

quality - not tested

How are these scores calculated?

hybrid server

The server is able to function both locally and remotely, depending on the configuration or use case.

Empower LLMs with fine-grained visual understanding — detect, localize, and describe anything in images with natural language prompts.

Related MCP Servers

Moondream MCP Server
NightTrek
-
security
A
license
-
quality
A powerful server that integrates the Moondream vision model to enable advanced image analysis, including captioning, object detection, and visual question answering, through the Model Context Protocol, compatible with AI assistants like Claude and Cline.
Last updated -
16
JavaScript
Apache 2.0
WolframAlpha LLM MCP Server
Garoth
A
security
F
license
A
quality
Enables querying WolframAlpha's LLM API for natural language questions, providing structured and simplified answers optimized for LLM consumption.
Last updated -
3
34
TypeScript
Model Context Protocol (MCP) Server for Home Assistant
drejom
-
security
A
license
-
quality
Enables seamless integration between Home Assistant and Language Learning Models (LLMs), allowing natural language interaction for smart home control and automation management.
Last updated -
TypeScript
Apache 2.0
MCP Image Extractor
ifmelate
A
security
A
license
A
quality
A Model Context Protocol server that extracts images from URLs or base64 data and converts them into a format suitable for LLM analysis, allowing AI models to process and understand visual content.
Last updated -
3
528
10
MIT License

View all related MCP servers