Skip to main content
Glama

DINO-X Image Detection MCP Server

Apache 2.0
53
2

DINO-X MCP

English | 中文

Enables large language models to perform fine-grained object detection and image understanding, powered by DINO-X and Grounding DINO 1.6 API.

💡 Why DINO-X MCP?

Although multimodal models can understand and describe images, they often lack precise localization and high-quality structured outputs for visual content.

With DINO-X MCP, you can:

🧠 Achieve fine-grained image understanding — both full-scene recognition and targeted detection based on natural language.

🎯 Accurately obtain object count, position, and attributes, enabling tasks such as visual question answering.

🧩 Integrate with other MCP Servers to build multi-step visual workflows.

🛠️ Build natural language-driven visual agents for real-world automation scenarios.

🎬 Use Case

🎯 Scenario📝 Input✨ Output
Detection & Localization💬 Prompt:Detect the fire areas in the forest and visualize with Canvas🖼️ Input Image:
Object Counting💬 Prompt:Please analyze this warehouse image, detect all the cardboard boxes, count the total number, and create a complete Canvas visualization webpage.🖼️ Input Image:
Feature Detection💬 Prompt:Find all red cars in the image and visualize with Canvas🖼️ Input Image:
Attribute Reasoning💬 Prompt:Find the tallest person in the image, describe their clothing, and visualize the result with Canvas🖼️ Input Image:
Full Scene Detection💬 Prompt:Find the fruit with the highest vitamin C content in the image🖼️ Input Image:Answer: Kiwi fruit (93mg/100g)
Pose Analysis💬 Prompt:Please analyze what yoga pose this is and overlay the keypoints on the original image using canvas🖼️ Input Image:

🚀 Quick Start

1. Prerequisites

Make sure you have Node.js installed. If you don't have Node.js, download it from nodejs.org.

Also, choose an AI assistants and applications that support the MCP Client, including but not limited to:

2. Configure MCP Sever

You can use DINO-X MCP server in two ways:

Option A: Using NPM Package 👍

Add the following configuration in your MCP client:

{ "mcpServers": { "dinox-mcp": { "command": "npx", "args": ["-y", "@deepdataspace/dinox-mcp"], "env": { "DINOX_API_KEY": "your-api-key-here" } } } }
Option B: Using Local Project

First, clone and build the project:

# Clone the project git clone https://github.com/IDEA-Research/DINO-X-MCP.git cd DINO-X-MCP # Install dependencies pnpm install # Build the project pnpm run build

Then configure your MCP client:

{ "mcpServers": { "dinox-mcp": { "command": "node", "args": ["/path/to/DINO-X-MCP/build/index.js"], "env": { "DINOX_API_KEY": "your-api-key-here" } } } }

3. Get API Key

Get your API key from DINO-X Platform (A free quota is available for new users).

Replace your-api-key-here in the configuration above with your actual API key.

4. Available Tools

Restart your MCP client, and you should be able to use the following tools:

Method NameDescriptionInputOutput
detect-all-objectsDetects and localizes all recognizable objects in an image.ImageCategory names + bounding boxes + captions
object-detection-by-textDetects and localizes objects in an image based on a natural language prompt.Image + Text promptBounding boxes + object captions
detect-human-pose-keypointsDetects 17 human body keypoints per person in an image for pose estimation.ImageKeypoint coordinates and captions

📝 Usage

Supported Image Formats

  • Remote URLs starting with https:// 👍
  • Local file paths (starting with file://)
  • Common image formats: jpg, jpeg, png, webp

API Docs

Please refer to DINO-X Platform for API usage limits and pricing information.

🛠️ Development

Watch Mode

During development, you can use watch mode for automatic rebuilding:

pnpm run watch

Debugging

Use MCP Inspector to debug the server:

pnpm run inspector

License

Apache License 2.0

-
security - not tested
A
license - permissive license
-
quality - not tested

Empower LLMs with fine-grained visual understanding — detect, localize, and describe anything in images with natural language prompts.

  1. 💡 Why DINO-X MCP?
    1. 🎬 Use Case
      1. 🚀 Quick Start
        1. Prerequisites
        2. Configure MCP Sever
        3. Get API Key
        4. Available Tools
      2. 📝 Usage
        1. Supported Image Formats
        2. API Docs
      3. 🛠️ Development
        1. Watch Mode
        2. Debugging
      4. License

        Related MCP Servers

        • -
          security
          A
          license
          -
          quality
          A powerful server that integrates the Moondream vision model to enable advanced image analysis, including captioning, object detection, and visual question answering, through the Model Context Protocol, compatible with AI assistants like Claude and Cline.
          Last updated -
          11
          JavaScript
          Apache 2.0
        • A
          security
          F
          license
          A
          quality
          Enables querying WolframAlpha's LLM API for natural language questions, providing structured and simplified answers optimized for LLM consumption.
          Last updated -
          3
          25
          TypeScript
        • A
          security
          A
          license
          A
          quality
          Chat with your codebase through intelligent code searching without embeddings by breaking files into logical chunks, giving the LLM tools to search these chunks, and letting it find specific code needed to answer your questions.
          Last updated -
          8
          51
          Python
          MIT License

        View all related MCP servers

        MCP directory API

        We provide all the information about MCP servers via our MCP API.

        curl -X GET 'https://glama.ai/api/mcp/v1/servers/IDEA-Research/DINO-X-MCP'

        If you have feedback or need assistance with the MCP directory API, please join our Discord server