The Robotics MCP Server provides unified control for both physical robots (Moorebot Scout, Unitree Go2/G1 via ROS) and virtual robots (in Unity, VRChat, Resonite) through a single interface.
Core Capabilities:
System Management: Get comprehensive help, check server status with health monitoring, and list all robots with filtering by type and physical/virtual status.
Robot Control & Movement: Control movement with linear/angular velocities, emergency stop, return to dock, and execute specific poses (stand, sit, walk gaits for Unitree). Sync virtual robots with physical robot states in real-time.
Virtual Robot Lifecycle (CRUD): Create, read, update, delete, and list virtual robots (vbots) with support for Scout, Scout E, Go2, G1, Robbie, and custom models. Update properties including position, scale, and metadata.
3D Model Management: Create robot models from scratch using Blender MCP, import/export models to/from game engines, and convert between formats (FBX, GLB, OBJ, VRM). Generate textures using GIMP MCP with realistic/stylized/simple styles.
Animation Control: Control wheel rotation for mecanum robots, play movement animations (walk, turn, idle), set poses, play custom animations with speed/loop controls, and query animation states.
Camera & Vision: Access live camera feeds from physical robots, get virtual camera views, adjust camera angles (pitch/yaw), capture still images, and manage video streaming.
Navigation & Path Planning: Plan paths using A* or RRT algorithms, execute planned paths with real-time following, set/clear waypoints for multi-point navigation, implement dynamic obstacle avoidance, and query navigation status.
Environment Management: Load environments from World Labs Marble/Chisel generators, get virtual LiDAR scans using Unity physics raycasting, and test navigation in virtual environments.
File Conversion: Convert Adobe .spz compressed files to .ply or .splat formats for Unity integration and extract metadata.
Hardware Integration: Support for LiDAR sensors (YDLIDAR SuperLight, Livox Mid-360), microcontrollers (Raspberry Pi Pico, ESP32, Arduino Nano), and pyroelectric motion sensors (AM312, HC-SR501).
Technical Features: Dual transport modes (stdio MCP protocol and HTTP FastAPI endpoints), ROS 1.4 Melodic integration via rosbridge_suite, mock mode for testing without hardware, multi-robot coordination, and composition of 6+ specialized MCP servers (osc-mcp, unity3d-mcp, vrchat-mcp, avatar-mcp, blender-mcp, gimp-mcp).
Enables automated 3D robot model creation and geometry generation for robotics applications
Provides texture creation and image processing capabilities for robot model development
Integrates with ROS 1.4 (Melodic) via rosbridge_suite for physical robot control, including Moorebot Scout and Unitree robots
Enables virtual robot instantiation, environment loading, and robot model import in Unity3D projects
Provides virtual robot control and integration capabilities within VRChat environments
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Robotics MCP Servermove the Scout robot forward 2 meters and scan the environment"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Robotics MCP Server
By FlowEngineer sandraschi
๐ Production-Ready Multi-Robot Coordination Platform with Enterprise Crash Protection
Revolutionary Multi-Robot Coordination: Dreame D20 Pro (primary), Yahboom ROSMASTER, Gazebo simulation, Tdrone Mini, Philips Hue Bridge Pro, and virtual robots collaborate through shared LIDAR maps, collaborative SLAM, RF-based movement detection, and real-time collision avoidance. Physical + virtual + simulated robots working as one super-intelligent system with 99.9% uptime guarantee.
Standing on the shoulders of giants: Leveraging auto-mapping innovation from Dreame engineers, ROS2 integration from Yahboom, PX4 flight control from ArduPilot, and the global robotics ecosystem. Protected by enterprise-grade watchfiles crash recovery.
๐ก๏ธ Enterprise Crash Protection
Zero-downtime operation with automatic crash recovery:
โ Watchfiles Protection: Automatic restart on any crash with exponential backoff
โ Health Monitoring: Real-time HTTP health checks every 30 seconds
โ Crash Analytics: Detailed JSON reports with full error analysis
โ Production Services: Systemd services for Linux deployment
โ Windows Support: PowerShell scripts for easy management
Result: 99.9% uptime for mission-critical robotics operations.
See Crash Protection Guide for complete setup.
โ ๏ธ CRITICAL REQUIREMENTS
Hardware (Recommended)
Physical Robot: Dreame D20 Pro (LIDAR vacuum), Moorebot Scout, Yahboom ROSMASTER, PX4/ArduPilot drones
Philips Hue Bridge Pro: For HomeAware RF-based movement detection (optional but recommended)
Without hardware: Virtual robotics only (Unity3D + VRChat)
Software (MANDATORY)
โ Unity 3D (6000.2.14f1+) - Installation Guide
โ VRChat - Installation Guide
โ 5 MCP Servers - Installation Guide
Without these, the system will not function. See Complete Setup Guide.
๐ค AI & Hardware Requirements
Physical Robotics (ROS2/SLAM):
Minimum: Raspberry Pi 5 / Jetson Orin Nano (On-board)
Recommended: Discrete GPU Workstation (RTX 3060+) for mapping/processing
Virtual Robotics (Unity/VRChat):
VR Ready PC: RTX 3060 or better recommended for smooth framerates
Local Intelligence (LLM):
Auto-Discovery: The system automatically detects and uses running Ollama or LM Studio instances.
70B Models: Requires RTX 3090/4090 (24GB VRAM) for real-time philosophy engine.
8B Models: Runs on RTX 3060+ or Mac Silicon.
Graceful Degradation: If no local LLM or high-end GPU is detected, AI features (conversation, advanced analysis) are disabled, but core control loops remain functional.
โ ๏ธ REQUIRED: Prerequisites & Dependencies
๐ด PHYSICAL ROBOTS (RECOMMENDED)
PRIMARY PLATFORM - Yahboom ROSMASTER Series (ROS 2):
Yahboom ROSMASTER M1/X3/X3 Plus - Multimodal AI robots with camera, navigation, optional arm/gripper
LiDAR easily addable for mapping/SLAM applications
Multiple sizes and extensive add-on ecosystem
Modern ROS2 platform with active community support
Perfect for: Beer can manipulation, object handling, AI research
WHY DREAME D20 PRO IS THE PERFECT STARTER ROBOT
Most robotics projects start with expensive, fragile hardware that sits on a shelf after the novelty wears off. The Dreame D20 Pro is the opposite: it is a real, useful household appliance that happens to be a sophisticated robotics platform.
Why it works:
Factor | Details |
Cheap | ~$200-300 on Amazon. Compare: Yahboom ROSMASTER $300-600, Unitree Go2 $1,600+, Boston Dynamics Spot $74,500 |
Available | Ships from Amazon in 1-2 days. No waiting for niche robotics suppliers |
Actually useful | It vacuums and mops your floor. Every day. Autonomously. Your partner will not complain about "that robot thing" gathering dust |
Advanced LIDAR | Full room-mapping LDS laser scanner. Generates floor plans exportable to OBJ, PLY, Unity NavMesh, Blender scripts |
Open software stack |
|
Autonomous operation | Auto-charges, auto-empties dustbin, runs on schedule for weeks unattended |
Cute factor | Watching it methodically navigate around chair legs and figure out room boundaries is genuinely endearing. Make it do a little dance (rapid zone changes) and it gets cuter still |
One missing thing | No camera. If it had one, it would be the perfect robotics starter platform. Use a Tapo C200 ($25) on a shelf for visual coverage |
The pitch: For the price of a nice dinner, you get a LIDAR-equipped autonomous robot that pays for itself by cleaning your flat while providing real sensor data for 3D visualization, path planning, and multi-robot coordination research.
COMPLETE ROBOT FLEET SUPPORT:
Primary Platform - Dreame D20 Pro (Owned, Recommended Starter):
Dreame D20 Pro - LIDAR vacuum robot with auto-mapping, zone cleaning, mop, and auto-empty station
No Android device required; use
discover_dreame.pyandget_dreame_token.pyfor setupLIDAR maps exportable to OBJ, PLY, Unity NavMesh JSON, Blender Python scripts
Secondary Platforms (Enhanced Ecosystem):
Gazebo Simulation - ROS simulated robots via rosbridge (no hardware required); see Gazebo Integration
Yahboom ROSMASTER M1/X3/X3 Plus - ROS2 robots with AI, optional arm/gripper (~$300-600)
Tdrone Mini - PX4/ArduPilot educational drone with FPV camera
Philips Hue Bridge Pro - Smart home hub with HomeAware RF movement detection
Moorebot Scout - Legacy ROS1 wheeled robot (compatibility mode)
Unitree Go2/G1 - Advanced quadrupedal robots (future hardware)
RECOMMENDED STARTER SETUPS:
Dreame-First Setup (Recommended - Start Here, ~$200-300):
Dreame D20 Pro (~$200-300 on Amazon) - LIDAR vacuum with zone cleaning, mapping, mop, auto-empty
Optionally add Tapo C200 (~$25) for visual coverage (the Dreame lacks a camera)
See Dreame Setup Guide for token and IP setup
Perfect for: LIDAR mapping, 3D export, path planning, "my first real robot"
ROS2 Platform (~$500-700):
Yahboom ROSMASTER M1 (~$300) - Compact ROS2 platform with AI capabilities
Raspberry Pi 5 (4GB) - May be included in some M1 bundles, otherwise ~$60-80
Perfect for: Learning ROS2, AI integration, arm/gripper manipulation
Full Featured Setup (~$800-1200):
Dreame D20 Pro (~$300) - Primary LIDAR robot (owned)
Yahboom ROSMASTER X3/X3 Plus (~$500-600) - ROS2 manipulation platform
Philips Hue Bridge Pro (~$200) - Smart home + RF movement detection
Perfect for: Multi-robot coordination, physical-virtual sync
๐บ Beer Can Manipulation Demo
Perfect use case for Yahboom ROSMASTER with arm addon:
Hardware Requirements:
Yahboom ROSMASTER X3 or X3 Plus (~$500-800)
Yahboom Robotic Arm Kit (~$150-200)
Parallel jaw gripper (~$30-50)
Total cost: ~$680-1050 for full beer can manipulation robot
๐ก REQUIRED SOFTWARE
MCPB CLI (Required for packaging distribution bundles)
Unity 3D (Required for virtual robotics)
VRChat (Required for social VR robotics)
๐ข REQUIRED MCP SERVERS
You MUST install and configure these MCP servers:
1. Unity3D-MCP (Virtual robot control)
2. OSC-MCP (Real-time communication)
3. VRChat-MCP (Social VR integration)
4. Blender-MCP (3D model creation)
5. Avatar-MCP (Avatar management)
6. Dreame D20 Pro Setup (Robot vacuum control - NO Android device required!)
Current State (2026-02-08, v0.2.0)
Alpha with real hardware integration. FastMCP 2.14+ compliant.
What Actually Works
Dreame D20 Pro - Full vacuum control + LIDAR map retrieval + 3D export (OBJ, PLY, Unity, Blender)
Yahboom ROSMASTER - Real roslibpy rosbridge client (connect, move, arm, gripper)
Elegoo - Real serial protocol communication
Gazebo Fuel - Model browser: search, download, spawn via ROS services
MCP Transport - Dual stdio + HTTP, FastMCP 2.14+ with
ctx: Contexton all toolsWebapp - Live MCP data, full sidebar navigation, 25+ pages, dark mode
13 Portmanteau Tools - All with
ctx: Contextand honest simulation labels
What is Mock/Stub (Labeled Honestly)
Unitree Go2/G1 - Returns
not_implementedDrone flight - Returns
simulated: TrueLLM provider connection - sleep + "connected"
Physical-virtual sync - Returns
simulated: True
See DEEP_ANALYSIS.md for the full mock audit and bug fix log.
๐ฏ Overview
Robotics MCP Server provides unified control for physical robots (Dreame D20 Pro, Yahboom ROSMASTER, Elegoo), simulated robots (Gazebo), virtual robots (Unity/VRChat/Resonite), and drones (PX4/ArduPilot). Primary hardware: Dreame D20 Pro with LIDAR 3D export pipeline.
Project Stats: ~12,000+ lines Python, ~5,000+ lines TypeScript/React, 13 portmanteau tools, 25+ webapp pages
Key Features
๐ค REVOLUTIONARY Multi-Robot Coordination: Yahboom manipulators + Dreame LIDAR mappers + virtual robots collaborate through shared maps, collaborative SLAM, and real-time collision avoidance - Complete Guide
๐บ๏ธ LIDAR Map Sharing: Dreame vacuum maps exported for Yahboom navigation, Unity simulation, and ROS autonomy
๐ Collaborative SLAM: Multi-perspective mapping with ground-level + elevated + aerial viewpoints
๐ก๏ธ Real-Time Collision Avoidance: Predictive safety system coordinating multiple robots simultaneously
๐ Physical + Virtual Integration: Test behaviors in Unity/VRChat, deploy to physical robots seamlessly
๐ Sensor Fusion: Combine LIDAR, cameras, IMUs, and depth sensors across different robot types
๐ฏ Task Allocation: Intelligent distribution of tasks based on robot capabilities and environment
โก Live Coordination: Sub-100ms decision making for multi-robot safety and efficiency
Robot Support
Physical Robots: Yahboom ROSMASTER (ROS2), Moorebot Scout (ROS1), Unitree Go2/G1/H1, Dreame D20 Pro vacuum
Virtual Robots: Unity3D, VRChat, Resonite with full physics simulation
Drone Integration: PX4/ArduPilot with MAVLink, video streaming, autonomous flight
Legacy Support: ROS Bridge integration for existing ROS1/ROS2 robots
World Labs Marble/Chisel: Environment generation and import
Drone Video Streaming: RTSP/WebRTC streaming with OpenIPC integration
Dual Transport: stdio (MCP) + HTTP (FastAPI) endpoints
MCP Server Composition: Ready for integration with
osc-mcp,unity3d-mcp,vrchat-mcp,avatar-mcp,blender-mcp,gimp-mcp(temporarily disabled)13 Portmanteau Tools:
robotics_system,robot_control,robot_behavior,robot_manufacturing,robot_virtual,robot_model_tools,vbot_crud,drone_control,dreame_control,gazebo_models,workflow_management,virtual_robotics,robot_navigationRobot Model Creation: Framework ready for automated 3D model creation
๐ Documentation
Setup Prerequisites โ ๏ธ REQUIRED: Complete installation guide for Unity3D, VRChat, and all MCP servers
AI Research Workflow ๐ง Architect first: AI-powered research methodology for all development
Vienna Technical Museum Makerspace ๐ ๏ธ Fantastic makerspace - free equipment, pay only consumables!
Progress Report ๐ Comprehensive project status and achievements!
Dreame Setup Guide ๐ค Complete guide for Dreame D20 Pro vacuum integration
Hue Bridge Pro Setup ๐ก Philips Hue Bridge Pro + HomeAware RF movement detection
Multi-Robot Coordination ๐ค Advanced collaborative robotics intelligence - the future is here!
Unity Vbot Instantiation Guide - Complete guide for instantiating virtual robots in Unity3D with proper terminology
๐ Quick Start
Prerequisites Check
โ ๏ธ BEFORE STARTING: Complete all Setup Prerequisites - Unity3D, VRChat, and MCP servers are REQUIRED.
๐ Installation
Prerequisites
uv installed (RECOMMENDED)
Python 3.12+
๐ฆ Quick Start
Run immediately via uvx:
๐ฏ Claude Desktop Integration
Add to your claude_desktop_config.json:
From PyPI (Recommended)
From GitHub Releases
For Development
๐ฆ Packaging & Distribution
This repository is SOTA 2026 compliant and uses the officially validated @anthropic-ai/mcpb workflow for distribution.
Pack Extension
To generate a .mcpb distribution bundle with complete source code and automated build exclusions:
Cursor MCP Integration
โ The robotics-mcp server now works in Cursor IDE!
Setup Steps:
Complete Prerequisites: Install Unity3D, VRChat, and all required MCP servers
Install the package:
pip install -e ".[dev]"Add to Cursor MCP configuration using the provided
mcpb.jsonThe server will automatically start when enabled in Cursor
Available Tools (13):
robotics_system- System management (help, status, list_robots)robot_control- Unified physical/virtual robot control (Dreame, Yahboom, Elegoo, Hue, virtual)robot_behavior- Advanced robot behavior, animation, and manipulationrobot_manufacturing- 3D printing, CNC, laser cutting operationsrobot_virtual- Virtual robotics environments and testingrobot_model_tools- 3D model creation, conversion, and optimizationvbot_crud- Virtual robot lifecycle management (create, read, update, delete)drone_control- Core drone flight operations (takeoff, land, move, status)dreame_control- Dreame D20 Pro: vacuum operations + LIDAR map 3D exportgazebo_models- Gazebo Fuel: search, download, spawn, manage local modelsworkflow_management- Robotics workflow orchestration and automationvirtual_robotics- Legacy virtual robotics operationsrobot_navigation- Path planning, obstacle avoidance, SLAM
MCP Server Integration
โ ENABLED WITH SAFETY: Unity3D-MCP is now enabled with robust error handling, timeouts, and fallbacks.
Active Integration:
osc-mcp: โ ENABLED - OSC communication for real-time robot controlunity3d-mcp: โ ENABLED - Unity3D integration for virtual roboticsvrchat-mcp: โธ๏ธ DISABLED - VRChat integration (protocol conflicts)avatar-mcp: โธ๏ธ DISABLED - Avatar management (timeseries conflicts)blender-mcp: โธ๏ธ DISABLED - 3D model creation (protocol hangs)gimp-mcp: โธ๏ธ DISABLED - Texture creation (protocol hangs)
Safety Features:
30-second timeouts for server loading
3 retry attempts with exponential backoff
Graceful fallbacks to mock operations if Unity unavailable
Never blocks robotics-mcp server operation
Comprehensive logging for debugging
Configuration: All required MCP servers are automatically loaded with error protection. If Unity is not available, virtual robot operations fall back to mock mode with full functionality preservation.
Configuration (Optional)
The server works out-of-the-box without configuration. For advanced setups, create ~/.robotics-mcp/config.yaml:
MCP Integration Config (for when mounted servers are re-enabled):
Running the Server
Primary Usage: Configure as MCP server in Cursor IDE using mcpb.json
Manual Operation (Development)
๐ ๏ธ Usage
MCP Tools
Robot Control (7 Robot Types Supported)
Dreame D20 Pro (Primary - Robot Vacuum):
Yahboom ROSMASTER (ROS2 Platform):
Tdrone Mini (Educational Drone):
Philips Hue Bridge Pro (Smart Home):
Moorebot Scout (Legacy ROS1):
Unitree Go2/G1: Supported when hardware available (stand, sit, walk actions).
Virtual Robotics
Robot Model Tools
Drone Control
Drone Streaming
Drone Navigation
Drone Flight Control
Web Interface
The Robotics MCP server includes a modern web-based control panel for easy robot management:
Features:
Real-time robot control with intuitive movement buttons
Live status monitoring (battery, position, sensors)
Camera capture and arm/gripper control
Command logging and connection status
Responsive design for desktop and mobile
See Web Interface Documentation for detailed usage instructions.
HTTP API
Health Check
List Robots
Control Robot
List Tools
Call Tool
๐ Documentation
ROS Fundamentals ๐ค Complete guide to the Robot Operating System - what ROS is, why it matters, core concepts, and ROS 1 vs ROS 2
LiDAR Guide ๐ก Affordable 3D sensing - Livox Mid-360 ($399), RPLIDAR ($99), integration, and robotics applications
Tiny Controllers Guide ๐ฎ Smallest microcontroller boards for robotics - Raspberry Pi Pico, ESP32, Arduino Nano, Teensy
Pyroelectric Sensors Guide ๐ Ultra-small motion detection - AM312 (6x4.5mm), HC-SR501, PIR sensors ($1-5)
Component Reuse Hacks ๐ง Creative electronics salvage - Philips Hue bulbs, HDD motors, smartphone cameras
World Labs Unity Integration Fix ๐ Resolve Marble .spz to Unity splat format incompatibilities + Scout vbot improvements
Import Nekomimi-chan VRM Guide ๐ฑ High-priority VRM avatar import for VRoid Studio model in avatar-mcp
Blender VRM Workflow for Robotics ๐ง Create custom VRM models for dogbots, diggers, articulated arms despite humanoid limitations
VRM Tools Alternatives ๐จ More generalized VRM creation tools beyond VRoid Studio for robots and non-humanoids
Comprehensive Project Notes ๐ Complete project documentation!
VRM vs Robot Models ๐ค VRM format guide - when to use VRM vs FBX/GLB
Unity Vbot Instantiation Guide ๐ฎ Complete guide for instantiating virtual robots in Unity3D
Quick Start: VRChat โก Get Scout into VRChat!
ROS 1.4 Local Setup ๐ณ Full local ROS environment for Scout!
VRChat Scout Setup - Complete guide
๐ก๏ธ Production & Deployment
Watchfiles Crash Protection - Enterprise crash recovery
Systemd Services - Linux production deployment
PowerShell Scripts - Windows management
๐ค Robot Integration Guides
Dreame D20 Pro Setup - Vacuum robot integration
Hue Bridge Pro Setup - Smart home integration
Multi-Robot Coordination - Collaborative robotics
Yahboom Integration - ROS2 robot setup
๐ง Development & Testing
Setup Prerequisites - Complete installation guide
Quick Start VRChat - VR social robotics
Unity Setup Guide - 3D virtual robotics
Comprehensive Notes - Technical deep-dive
๐งช Testing
Comprehensive test suite: 21 test files, 2,642 lines of tests covering all 11 tools!
๐ง Development
Project Structure
Code Quality
๐ง Troubleshooting
Cursor MCP Integration Issues
Problem: Server not appearing in Cursor MCP tools
Symptoms:
"robotics-mcp" not showing in MCP tools list
Tools not available in Cursor
Quick Fix:
Open Cursor Settings โ Features โ Model Context Protocol
Add new server using the
mcpb.jsonconfigurationEnsure the server shows as "Healthy" in the list
Restart Cursor if needed
Server Status Check:
Configuration File: Use mcpb.json in the project root for Cursor MCP setup.
Other Issues
Server won't start:
Check Python version:
python --version(requires 3.10+)Verify dependencies:
pip install -e ".[dev]"Check logs:
C:\Users\sandr\AppData\Roaming\Cursor\logs\
Tools not appearing:
Verify MCP server is enabled in Cursor IDE settings
Check server logs for errors
Try disabling and re-enabling the server
Unity integration not working:
Ensure Unity Editor is running
Verify Unity project path is correct
Check
unity3d-mcpserver is healthy
๐ค Contributing
Contributions welcome! Please see CONTRIBUTING.md for guidelines.
๐ License
MIT License - see LICENSE for details.
๐ Acknowledgments
FastMCP framework
ROS community
Unity3D, VRChat, World Labs Marble/Chisel
MCP ecosystem contributors
Status: Alpha v0.2.0 (2026-02-08) - FastMCP 2.14+ compliant, Dreame D20 Pro working, Yahboom roslibpy integrated, Gazebo Fuel browser operational, webapp fully navigable.
MCP Server Composition: osc-mcp enabled, unity3d-mcp enabled (with safety), vrchat-mcp/avatar-mcp/blender-mcp/gimp-mcp temporarily disabled for stability.
Deep Analysis: See DEEP_ANALYSIS.md for comprehensive code audit, mock inventory, and bug fix log.