The Robotics MCP Server provides unified control for both physical robots (Moorebot Scout, Unitree Go2/G1 via ROS) and virtual robots (in Unity, VRChat, Resonite) through a single interface.
Core Capabilities:
System Management: Get comprehensive help, check server status with health monitoring, and list all robots with filtering by type and physical/virtual status.
Robot Control & Movement: Control movement with linear/angular velocities, emergency stop, return to dock, and execute specific poses (stand, sit, walk gaits for Unitree). Sync virtual robots with physical robot states in real-time.
Virtual Robot Lifecycle (CRUD): Create, read, update, delete, and list virtual robots (vbots) with support for Scout, Scout E, Go2, G1, Robbie, and custom models. Update properties including position, scale, and metadata.
3D Model Management: Create robot models from scratch using Blender MCP, import/export models to/from game engines, and convert between formats (FBX, GLB, OBJ, VRM). Generate textures using GIMP MCP with realistic/stylized/simple styles.
Animation Control: Control wheel rotation for mecanum robots, play movement animations (walk, turn, idle), set poses, play custom animations with speed/loop controls, and query animation states.
Camera & Vision: Access live camera feeds from physical robots, get virtual camera views, adjust camera angles (pitch/yaw), capture still images, and manage video streaming.
Navigation & Path Planning: Plan paths using A* or RRT algorithms, execute planned paths with real-time following, set/clear waypoints for multi-point navigation, implement dynamic obstacle avoidance, and query navigation status.
Environment Management: Load environments from World Labs Marble/Chisel generators, get virtual LiDAR scans using Unity physics raycasting, and test navigation in virtual environments.
File Conversion: Convert Adobe .spz compressed files to .ply or .splat formats for Unity integration and extract metadata.
Hardware Integration: Support for LiDAR sensors (YDLIDAR SuperLight, Livox Mid-360), microcontrollers (Raspberry Pi Pico, ESP32, Arduino Nano), and pyroelectric motion sensors (AM312, HC-SR501).
Technical Features: Dual transport modes (stdio MCP protocol and HTTP FastAPI endpoints), ROS 1.4 Melodic integration via rosbridge_suite, mock mode for testing without hardware, multi-robot coordination, and composition of 6+ specialized MCP servers (osc-mcp, unity3d-mcp, vrchat-mcp, avatar-mcp, blender-mcp, gimp-mcp).
Enables automated 3D robot model creation and geometry generation for robotics applications
Provides texture creation and image processing capabilities for robot model development
Integrates with ROS 1.4 (Melodic) via rosbridge_suite for physical robot control, including Moorebot Scout and Unitree robots
Enables virtual robot instantiation, environment loading, and robot model import in Unity3D projects
Provides virtual robot control and integration capabilities within VRChat environments
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Robotics MCP Servermove the Scout robot forward 2 meters and scan the environment"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Robotics MCP Server
By FlowEngineer sandraschi
๐ Production-Ready Multi-Robot Coordination Platform with Enterprise Crash Protection
Revolutionary Multi-Robot Coordination: Yahboom ROSMASTER, Dreame D20 Pro, Tdrone Mini, Unitree Go2/G1, and Philips Hue Bridge Pro collaborate through shared LIDAR maps, collaborative SLAM, RF-based movement detection, and real-time collision avoidance. Physical + virtual robots working as one super-intelligent system with 99.9% uptime guarantee.
Standing on the shoulders of giants: Leveraging auto-mapping innovation from Dreame engineers, ROS2 integration from Yahboom, PX4 flight control from ArduPilot, and the global robotics ecosystem. Protected by enterprise-grade watchfiles crash recovery.
๐ก๏ธ Enterprise Crash Protection
Zero-downtime operation with automatic crash recovery:
โ Watchfiles Protection: Automatic restart on any crash with exponential backoff
โ Health Monitoring: Real-time HTTP health checks every 30 seconds
โ Crash Analytics: Detailed JSON reports with full error analysis
โ Production Services: Systemd services for Linux deployment
โ Windows Support: PowerShell scripts for easy management
Result: 99.9% uptime for mission-critical robotics operations.
See Crash Protection Guide for complete setup.
โ ๏ธ CRITICAL REQUIREMENTS
Hardware (Recommended)
Physical Robot: Moorebot Scout, Unitree Go2/G1/H1, PX4/ArduPilot drones
Philips Hue Bridge Pro: For HomeAware RF-based movement detection (optional but recommended)
Without hardware: Virtual robotics only (Unity3D + VRChat)
Software (MANDATORY)
โ Unity 3D (6000.2.14f1+) - Installation Guide
โ VRChat - Installation Guide
โ 5 MCP Servers - Installation Guide
Without these, the system will not function. See Complete Setup Guide.
โ ๏ธ REQUIRED: Prerequisites & Dependencies
๐ด PHYSICAL ROBOTS (RECOMMENDED)
PRIMARY PLATFORM - Yahboom ROSMASTER Series (ROS 2):
Yahboom ROSMASTER M1/X3/X3 Plus - Multimodal AI robots with camera, navigation, optional arm/gripper
LiDAR easily addable for mapping/SLAM applications
Multiple sizes and extensive add-on ecosystem
Modern ROS2 platform with active community support
Perfect for: Beer can manipulation, object handling, AI research
COMPLETE ROBOT FLEET SUPPORT:
๐ค Yahboom ROSMASTER X3/X3 Plus - ROS2 wheeled robot with AI vision and optional arm
๐งน Dreame D20 Pro - LIDAR vacuum robot with auto-mapping and zone cleaning
๐ Tdrone Mini - PX4/ArduPilot educational drone with FPV camera
๐ก Philips Hue Bridge Pro - Smart home hub with HomeAware RF movement detection
๐ Unitree Go2/G1/H1 - Advanced quadrupedal and humanoid robots
๐ง Moorebot Scout - Legacy ROS1 wheeled robot (compatibility mode)
RECOMMENDED STARTER SETUP (~$800-1200):
Yahboom ROSMASTER X3 (~$500) - Main robot platform
Dreame D20 Pro (~$300) - Vacuum robot for testing
Philips Hue Bridge Pro (~$200) - Smart home integration
Optional: Yahboom Arm Kit (~$150) - For manipulation tasks
All robots work together through multi-robot coordination. Yahboom ROSMASTER is primary, others enhance the ecosystem.
๐บ Beer Can Manipulation Demo
Perfect use case for Yahboom ROSMASTER with arm addon:
Hardware Requirements:
Yahboom ROSMASTER X3 or X3 Plus (~$500-800)
Yahboom Robotic Arm Kit (~$150-200)
Parallel jaw gripper (~$30-50)
Total cost: ~$680-1050 for full beer can manipulation robot
๐ก REQUIRED SOFTWARE
You MUST install these applications:
Unity 3D (Required for virtual robotics)
VRChat (Required for social VR robotics)
๐ข REQUIRED MCP SERVERS
You MUST install and configure these MCP servers:
1. Unity3D-MCP (Virtual robot control)
2. OSC-MCP (Real-time communication)
3. VRChat-MCP (Social VR integration)
4. Blender-MCP (3D model creation)
5. Avatar-MCP (Avatar management)
6. Dreame D20 Pro Setup (Robot vacuum control - NO Android device required!)
โ ๏ธ Important: Alpha Status & Current State
This server is in ALPHA status with Cursor MCP integration working:
โ Cursor MCP Integration: Server now starts successfully in Cursor IDE
โ Unity Integration: Now enabled with robust error handling and fallbacks
โธ๏ธ Other MCP Servers: Composition temporarily limited for stability
Status: Active development - features may change, break, or be incomplete
Virtual Robotics: Prioritized (vbot) - physical robot support coming after hardware arrives (XMas 2025)
Core Functionality: 7 portmanteau tools available for robot control and management
See Cursor MCP Setup section for integration details.
๐ฏ Overview
Robotics MCP Server provides unified control for physical robots (ROS2-based), virtual robots (Unity/VRChat), and drones (PX4/ArduPilot), with a primary focus on Yahboom ROSMASTER Series and virtual robotics testing. Legacy ROS1 robots (Moorebot Scout, etc.) supported for compatibility.
๐ Project Stats: ~9,200 lines of code, ~2,600 lines of tests, ~4,100 lines of documentation
โ ๏ธ ALPHA STATUS - CURSOR INTEGRATION WORKING: Server successfully starts in Cursor MCP mode. Mounted servers temporarily disabled for stability.
Key Features
๐ค REVOLUTIONARY Multi-Robot Coordination: Yahboom manipulators + Dreame LIDAR mappers + virtual robots collaborate through shared maps, collaborative SLAM, and real-time collision avoidance - Complete Guide
๐บ๏ธ LIDAR Map Sharing: Dreame vacuum maps exported for Yahboom navigation, Unity simulation, and ROS autonomy
๐ Collaborative SLAM: Multi-perspective mapping with ground-level + elevated + aerial viewpoints
๐ก๏ธ Real-Time Collision Avoidance: Predictive safety system coordinating multiple robots simultaneously
๐ Physical + Virtual Integration: Test behaviors in Unity/VRChat, deploy to physical robots seamlessly
๐ Sensor Fusion: Combine LIDAR, cameras, IMUs, and depth sensors across different robot types
๐ฏ Task Allocation: Intelligent distribution of tasks based on robot capabilities and environment
โก Live Coordination: Sub-100ms decision making for multi-robot safety and efficiency
Robot Support
Physical Robots: Yahboom ROSMASTER (ROS2), Moorebot Scout (ROS1), Unitree Go2/G1/H1, Dreame D20 Pro vacuum
Virtual Robots: Unity3D, VRChat, Resonite with full physics simulation
Drone Integration: PX4/ArduPilot with MAVLink, video streaming, autonomous flight
Legacy Support: ROS Bridge integration for existing ROS1/ROS2 robots
World Labs Marble/Chisel: Environment generation and import
Drone Video Streaming: RTSP/WebRTC streaming with OpenIPC integration
Dual Transport: stdio (MCP) + HTTP (FastAPI) endpoints
MCP Server Composition: Ready for integration with
osc-mcp,unity3d-mcp,vrchat-mcp,avatar-mcp,blender-mcp,gimp-mcp(temporarily disabled)14 Portmanteau Tools:
robotics_system,robot_control,robot_behavior,robot_manufacturing,robot_virtual,robot_model_tools,vbot_crud,drone_control,drone_streaming,drone_navigation,drone_flight_control,workflow_management,robot_navigation,robot_camera,robot_animationRobot Model Creation: Framework ready for automated 3D model creation
๐ Documentation
Setup Prerequisites โ ๏ธ REQUIRED: Complete installation guide for Unity3D, VRChat, and all MCP servers
AI Research Workflow ๐ง Architect first: AI-powered research methodology for all development
Vienna Technical Museum Makerspace ๐ ๏ธ Fantastic makerspace - free equipment, pay only consumables!
Progress Report ๐ Comprehensive project status and achievements!
Dreame Setup Guide ๐ค Complete guide for Dreame D20 Pro vacuum integration
Hue Bridge Pro Setup ๐ก Philips Hue Bridge Pro + HomeAware RF movement detection
Multi-Robot Coordination ๐ค Advanced collaborative robotics intelligence - the future is here!
Unity Vbot Instantiation Guide - Complete guide for instantiating virtual robots in Unity3D with proper terminology
๐ Quick Start
Prerequisites Check
โ ๏ธ BEFORE STARTING: Complete all Setup Prerequisites - Unity3D, VRChat, and MCP servers are REQUIRED.
Installation
From PyPI (Recommended)
From GitHub Releases
For Development
Cursor MCP Integration
โ The robotics-mcp server now works in Cursor IDE!
Setup Steps:
Complete Prerequisites: Install Unity3D, VRChat, and all required MCP servers
Install the package:
pip install -e ".[dev]"Add to Cursor MCP configuration using the provided
mcpb.jsonThe server will automatically start when enabled in Cursor
Available Tools:
robotics_system- System management (help, status, list_robots)robot_control- Unified physical & virtual robot control (Yahboom primary, Scout/Unitree legacy, Dreame vacuums)robot_behavior- Advanced robot behavior, animation, and manipulationrobot_manufacturing- 3D printing, CNC, laser cutting operationsrobot_virtual- Virtual robotics environments and testingrobot_model_tools- 3D model creation, conversion, and optimizationvbot_crud- Virtual robot lifecycle management (create, read, update, delete)drone_control- Core drone flight operations (takeoff, land, move, status)drone_streaming- Video streaming and recording (FPV, RTSP, WebRTC)drone_navigation- GPS navigation and waypoints (follow_me, geofencing)drone_flight_control- Advanced flight modes (missions, parameter tuning)workflow_management- Robotics workflow orchestration and automationrobot_navigation- Path planning, obstacle avoidance, SLAMrobot_camera- Camera control, computer vision, object detectionrobot_animation- Animation sequences, motion planning, kinematics
MCP Server Integration
โ ENABLED WITH SAFETY: Unity3D-MCP is now enabled with robust error handling, timeouts, and fallbacks.
Active Integration:
osc-mcp: โ ENABLED - OSC communication for real-time robot controlunity3d-mcp: โ ENABLED - Unity3D integration for virtual roboticsvrchat-mcp: โธ๏ธ DISABLED - VRChat integration (protocol conflicts)avatar-mcp: โธ๏ธ DISABLED - Avatar management (timeseries conflicts)blender-mcp: โธ๏ธ DISABLED - 3D model creation (protocol hangs)gimp-mcp: โธ๏ธ DISABLED - Texture creation (protocol hangs)
Safety Features:
30-second timeouts for server loading
3 retry attempts with exponential backoff
Graceful fallbacks to mock operations if Unity unavailable
Never blocks robotics-mcp server operation
Comprehensive logging for debugging
Configuration: All required MCP servers are automatically loaded with error protection. If Unity is not available, virtual robot operations fall back to mock mode with full functionality preservation.
Configuration (Optional)
The server works out-of-the-box without configuration. For advanced setups, create ~/.robotics-mcp/config.yaml:
MCP Integration Config (for when mounted servers are re-enabled):
Running the Server
Primary Usage: Configure as MCP server in Cursor IDE using mcpb.json
Manual Operation (Development)
๐ ๏ธ Usage
MCP Tools
Robot Control (7 Robot Types Supported)
๐ค Yahboom ROSMASTER (Primary Platform):
๐งน Dreame D20 Pro (Vacuum Robot):
๐ Tdrone Mini (Educational Drone):
๐ก Philips Hue Bridge Pro (Smart Home):
๐ Unitree Go2/G1 (Advanced Robots):
๐ง Moorebot Scout (Legacy ROS1):
Virtual Robotics
Robot Model Tools
Drone Control
Drone Streaming
Drone Navigation
Drone Flight Control
Web Interface
The Robotics MCP server includes a modern web-based control panel for easy robot management:
Features:
Real-time robot control with intuitive movement buttons
Live status monitoring (battery, position, sensors)
Camera capture and arm/gripper control
Command logging and connection status
Responsive design for desktop and mobile
See Web Interface Documentation for detailed usage instructions.
HTTP API
Health Check
List Robots
Control Robot
List Tools
Call Tool
๐ Documentation
ROS Fundamentals ๐ค Complete guide to the Robot Operating System - what ROS is, why it matters, core concepts, and ROS 1 vs ROS 2
LiDAR Guide ๐ก Affordable 3D sensing - Livox Mid-360 ($399), RPLIDAR ($99), integration, and robotics applications
Tiny Controllers Guide ๐ฎ Smallest microcontroller boards for robotics - Raspberry Pi Pico, ESP32, Arduino Nano, Teensy
Pyroelectric Sensors Guide ๐ Ultra-small motion detection - AM312 (6x4.5mm), HC-SR501, PIR sensors ($1-5)
Component Reuse Hacks ๐ง Creative electronics salvage - Philips Hue bulbs, HDD motors, smartphone cameras
World Labs Unity Integration Fix ๐ Resolve Marble .spz to Unity splat format incompatibilities + Scout vbot improvements
Import Nekomimi-chan VRM Guide ๐ฑ High-priority VRM avatar import for VRoid Studio model in avatar-mcp
Blender VRM Workflow for Robotics ๐ง Create custom VRM models for dogbots, diggers, articulated arms despite humanoid limitations
VRM Tools Alternatives ๐จ More generalized VRM creation tools beyond VRoid Studio for robots and non-humanoids
Comprehensive Project Notes ๐ Complete project documentation!
VRM vs Robot Models ๐ค VRM format guide - when to use VRM vs FBX/GLB
Unity Vbot Instantiation Guide ๐ฎ Complete guide for instantiating virtual robots in Unity3D
Quick Start: VRChat โก Get Scout into VRChat!
ROS 1.4 Local Setup ๐ณ Full local ROS environment for Scout!
VRChat Scout Setup - Complete guide
๐ก๏ธ Production & Deployment
Watchfiles Crash Protection - Enterprise crash recovery
Systemd Services - Linux production deployment
PowerShell Scripts - Windows management
๐ค Robot Integration Guides
Dreame D20 Pro Setup - Vacuum robot integration
Hue Bridge Pro Setup - Smart home integration
Multi-Robot Coordination - Collaborative robotics
Yahboom Integration - ROS2 robot setup
๐ง Development & Testing
Setup Prerequisites - Complete installation guide
Quick Start VRChat - VR social robotics
Unity Setup Guide - 3D virtual robotics
Comprehensive Notes - Technical deep-dive
๐งช Testing
Comprehensive test suite: 21 test files, 2,642 lines of tests covering all 11 tools!
๐ง Development
Project Structure
Code Quality
๐ง Troubleshooting
Cursor MCP Integration Issues
Problem: Server not appearing in Cursor MCP tools
Symptoms:
"robotics-mcp" not showing in MCP tools list
Tools not available in Cursor
Quick Fix:
Open Cursor Settings โ Features โ Model Context Protocol
Add new server using the
mcpb.jsonconfigurationEnsure the server shows as "Healthy" in the list
Restart Cursor if needed
Server Status Check:
Configuration File: Use mcpb.json in the project root for Cursor MCP setup.
Other Issues
Server won't start:
Check Python version:
python --version(requires 3.10+)Verify dependencies:
pip install -e ".[dev]"Check logs:
C:\Users\sandr\AppData\Roaming\Cursor\logs\
Tools not appearing:
Verify MCP server is enabled in Cursor IDE settings
Check server logs for errors
Try disabling and re-enabling the server
Unity integration not working:
Ensure Unity Editor is running
Verify Unity project path is correct
Check
unity3d-mcpserver is healthy
๐ค Contributing
Contributions welcome! Please see CONTRIBUTING.md for guidelines.
๐ License
MIT License - see LICENSE for details.
๐ Acknowledgments
FastMCP framework
ROS community
Unity3D, VRChat, World Labs Marble/Chisel
MCP ecosystem contributors
Status: โ ALPHA - Cursor Integration Working - Core robotics-mcp functionality operational, mounted servers temporarily disabled for stability
โธ๏ธ MCP Server Composition: Currently runs standalone. Integration with osc-mcp, unity3d-mcp, vrchat-mcp, avatar-mcp, blender-mcp, gimp-mcp planned for future releases.