The Robotics MCP Server provides unified control for both physical robots (Moorebot Scout, Unitree Go2/G1 via ROS) and virtual robots (in Unity, VRChat, Resonite) through a single interface.
Core Capabilities:
System Management: Get comprehensive help, check server status with health monitoring, and list all robots with filtering by type and physical/virtual status.
Robot Control & Movement: Control movement with linear/angular velocities, emergency stop, return to dock, and execute specific poses (stand, sit, walk gaits for Unitree). Sync virtual robots with physical robot states in real-time.
Virtual Robot Lifecycle (CRUD): Create, read, update, delete, and list virtual robots (vbots) with support for Scout, Scout E, Go2, G1, Robbie, and custom models. Update properties including position, scale, and metadata.
3D Model Management: Create robot models from scratch using Blender MCP, import/export models to/from game engines, and convert between formats (FBX, GLB, OBJ, VRM). Generate textures using GIMP MCP with realistic/stylized/simple styles.
Animation Control: Control wheel rotation for mecanum robots, play movement animations (walk, turn, idle), set poses, play custom animations with speed/loop controls, and query animation states.
Camera & Vision: Access live camera feeds from physical robots, get virtual camera views, adjust camera angles (pitch/yaw), capture still images, and manage video streaming.
Navigation & Path Planning: Plan paths using A* or RRT algorithms, execute planned paths with real-time following, set/clear waypoints for multi-point navigation, implement dynamic obstacle avoidance, and query navigation status.
Environment Management: Load environments from World Labs Marble/Chisel generators, get virtual LiDAR scans using Unity physics raycasting, and test navigation in virtual environments.
File Conversion: Convert Adobe .spz compressed files to .ply or .splat formats for Unity integration and extract metadata.
Hardware Integration: Support for LiDAR sensors (YDLIDAR SuperLight, Livox Mid-360), microcontrollers (Raspberry Pi Pico, ESP32, Arduino Nano), and pyroelectric motion sensors (AM312, HC-SR501).
Technical Features: Dual transport modes (stdio MCP protocol and HTTP FastAPI endpoints), ROS 1.4 Melodic integration via rosbridge_suite, mock mode for testing without hardware, multi-robot coordination, and composition of 6+ specialized MCP servers (osc-mcp, unity3d-mcp, vrchat-mcp, avatar-mcp, blender-mcp, gimp-mcp).
Enables automated 3D robot model creation and geometry generation for robotics applications
Provides texture creation and image processing capabilities for robot model development
Integrates with ROS 1.4 (Melodic) via rosbridge_suite for physical robot control, including Moorebot Scout and Unitree robots
Enables virtual robot instantiation, environment loading, and robot model import in Unity3D projects
Provides virtual robot control and integration capabilities within VRChat environments
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Robotics MCP Servermove the Scout robot forward 2 meters and scan the environment"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Robotics MCP Server
By FlowEngineer sandraschi
Unified robotics control via MCP - Physical and virtual robots (bot + vbot)
⚠️ CRITICAL REQUIREMENTS
Hardware (Recommended)
Physical Robot: Moorebot Scout, Unitree Go2/G1/H1
Without hardware: Virtual robotics only (Unity3D + VRChat)
Software (MANDATORY)
✅ Unity 3D (6000.2.14f1+) - Installation Guide
✅ VRChat - Installation Guide
✅ 5 MCP Servers - Installation Guide
Without these, the system will not function. See Complete Setup Guide.
⚠️ REQUIRED: Prerequisites & Dependencies
🔴 PHYSICAL ROBOTS (RECOMMENDED)
You SHOULD own one of these supported robots:
Moorebot Scout (primary focus) - Mecanum wheeled robot with LiDAR
Unitree Go2 - Advanced quadrupedal robot
Unitree G1 - Humanoid robot with arms
Unitree H1 - Humanoid robot platform
Physical robots provide the complete robotics experience. Virtual robots are for testing/simulation.
🟡 REQUIRED SOFTWARE
You MUST install these applications:
Unity 3D (Required for virtual robotics)
VRChat (Required for social VR robotics)
🟢 REQUIRED MCP SERVERS
You MUST install and configure these MCP servers:
1. Unity3D-MCP (Virtual robot control)
2. OSC-MCP (Real-time communication)
3. VRChat-MCP (Social VR integration)
4. Blender-MCP (3D model creation)
5. Avatar-MCP (Avatar management)
⚠️ Important: Alpha Status & Current State
This server is in ALPHA status with Cursor MCP integration working:
✅ Cursor MCP Integration: Server now starts successfully in Cursor IDE
✅ Unity Integration: Now enabled with robust error handling and fallbacks
⏸️ Other MCP Servers: Composition temporarily limited for stability
Status: Active development - features may change, break, or be incomplete
Virtual Robotics: Prioritized (vbot) - physical robot support coming after hardware arrives (XMas 2025)
Core Functionality: 7 portmanteau tools available for robot control and management
See Cursor MCP Setup section for integration details.
🎯 Overview
Robotics MCP Server provides unified control for both physical robots (ROS-based) and virtual robots (Unity/VRChat), with a focus on Moorebot Scout, Unitree robots, and virtual robotics testing.
🚀 Project Stats: ~9,200 lines of code, ~2,600 lines of tests, ~4,100 lines of documentation
⚠️ ALPHA STATUS - CURSOR INTEGRATION WORKING: Server successfully starts in Cursor MCP mode. Mounted servers temporarily disabled for stability.
Key Features
Physical Robot Control: Moorebot Scout (ROS 1.4), Unitree Go2/G1
YDLIDAR SuperLight (95g) LiDAR integration for Scout
Virtual Robot Control: Unity3D/VRChat/Resonite integration via existing MCP servers
ROS Bridge Integration: Robot Operating System 1.4 (Melodic) via rosbridge_suite
LiDAR Sensing: Affordable 3D LiDAR Guide - Livox Mid-360 ($399), RPLIDAR ($99), and more
Tiny Controllers: Pico & Micro Boards - Raspberry Pi Pico, ESP32, Arduino Nano for small robots
Motion Detection: Pyroelectric Sensors Guide - AM312, HC-SR501 ultra-small PIR sensors ($1-5)
Multi-Robot Coordination: Physical and virtual robots together
World Labs Marble/Chisel: Environment generation and import
Dual Transport: stdio (MCP) + HTTP (FastAPI) endpoints
MCP Server Composition: Ready for integration with
osc-mcp,unity3d-mcp,vrchat-mcp,avatar-mcp,blender-mcp,gimp-mcp(temporarily disabled)7 Portmanteau Tools:
robotics_system,robot_control,robot_behavior,robot_manufacturing,robot_virtual,robot_model_tools,vbot_crudRobot Model Creation: Framework ready for automated 3D model creation
📚 Documentation
Setup Prerequisites ⚠️ REQUIRED: Complete installation guide for Unity3D, VRChat, and all MCP servers
AI Research Workflow 🧠 Architect first: AI-powered research methodology for all development
Vienna Technical Museum Makerspace 🛠️ Fantastic makerspace - free equipment, pay only consumables!
Progress Report 🎉 Comprehensive project status and achievements!
Unity Vbot Instantiation Guide - Complete guide for instantiating virtual robots in Unity3D with proper terminology
🚀 Quick Start
Prerequisites Check
⚠️ BEFORE STARTING: Complete all Setup Prerequisites - Unity3D, VRChat, and MCP servers are REQUIRED.
Cursor MCP Integration
✅ The robotics-mcp server now works in Cursor IDE!
Setup Steps:
Complete Prerequisites: Install Unity3D, VRChat, and all required MCP servers
Install the package:
pip install -e ".[dev]"Add to Cursor MCP configuration using the provided
mcpb.jsonThe server will automatically start when enabled in Cursor
Available Tools:
robotics_system- System management (help, status, list_robots)robot_control- Physical robot control (ready for hardware)robot_behavior- Robot behavior and animationrobot_manufacturing- 3D printing and CNC controlrobot_virtual- Virtual robotics operationsrobot_model_tools- Model creation and conversionvbot_crud- Virtual robot lifecycle management
MCP Server Integration
✅ ENABLED WITH SAFETY: Unity3D-MCP is now enabled with robust error handling, timeouts, and fallbacks.
Active Integration:
osc-mcp: ✅ ENABLED - OSC communication for real-time robot controlunity3d-mcp: ✅ ENABLED - Unity3D integration for virtual roboticsvrchat-mcp: ⏸️ DISABLED - VRChat integration (protocol conflicts)avatar-mcp: ⏸️ DISABLED - Avatar management (timeseries conflicts)blender-mcp: ⏸️ DISABLED - 3D model creation (protocol hangs)gimp-mcp: ⏸️ DISABLED - Texture creation (protocol hangs)
Safety Features:
30-second timeouts for server loading
3 retry attempts with exponential backoff
Graceful fallbacks to mock operations if Unity unavailable
Never blocks robotics-mcp server operation
Comprehensive logging for debugging
Configuration: All required MCP servers are automatically loaded with error protection. If Unity is not available, virtual robot operations fall back to mock mode with full functionality preservation.
Configuration (Optional)
The server works out-of-the-box without configuration. For advanced setups, create ~/.robotics-mcp/config.yaml:
MCP Integration Config (for when mounted servers are re-enabled):
Running the Server
Primary Usage: Configure as MCP server in Cursor IDE using mcpb.json
Manual Operation (Development)
🛠️ Usage
MCP Tools
Robot Control
Virtual Robotics
Robot Model Tools
HTTP API
Health Check
List Robots
Control Robot
List Tools
Call Tool
📚 Documentation
ROS Fundamentals 🤖 Complete guide to the Robot Operating System - what ROS is, why it matters, core concepts, and ROS 1 vs ROS 2
LiDAR Guide 📡 Affordable 3D sensing - Livox Mid-360 ($399), RPLIDAR ($99), integration, and robotics applications
Tiny Controllers Guide 🎮 Smallest microcontroller boards for robotics - Raspberry Pi Pico, ESP32, Arduino Nano, Teensy
Pyroelectric Sensors Guide 🔍 Ultra-small motion detection - AM312 (6x4.5mm), HC-SR501, PIR sensors ($1-5)
Component Reuse Hacks 🔧 Creative electronics salvage - Philips Hue bulbs, HDD motors, smartphone cameras
World Labs Unity Integration Fix 🏠 Resolve Marble .spz to Unity splat format incompatibilities + Scout vbot improvements
Import Nekomimi-chan VRM Guide 🐱 High-priority VRM avatar import for VRoid Studio model in avatar-mcp
Blender VRM Workflow for Robotics 🔧 Create custom VRM models for dogbots, diggers, articulated arms despite humanoid limitations
VRM Tools Alternatives 🎨 More generalized VRM creation tools beyond VRoid Studio for robots and non-humanoids
Comprehensive Project Notes 📖 Complete project documentation!
VRM vs Robot Models 🤖 VRM format guide - when to use VRM vs FBX/GLB
Unity Vbot Instantiation Guide 🎮 Complete guide for instantiating virtual robots in Unity3D
Quick Start: VRChat ⚡ Get Scout into VRChat!
ROS 1.4 Local Setup 🐳 Full local ROS environment for Scout!
VRChat Scout Setup - Complete guide
🧪 Testing
Comprehensive test suite: 21 test files, 2,642 lines of tests covering all 11 tools!
🔧 Development
Project Structure
Code Quality
🔧 Troubleshooting
Cursor MCP Integration Issues
Problem: Server not appearing in Cursor MCP tools
Symptoms:
"robotics-mcp" not showing in MCP tools list
Tools not available in Cursor
Quick Fix:
Open Cursor Settings → Features → Model Context Protocol
Add new server using the
mcpb.jsonconfigurationEnsure the server shows as "Healthy" in the list
Restart Cursor if needed
Server Status Check:
Configuration File: Use mcpb.json in the project root for Cursor MCP setup.
Other Issues
Server won't start:
Check Python version:
python --version(requires 3.10+)Verify dependencies:
pip install -e ".[dev]"Check logs:
C:\Users\sandr\AppData\Roaming\Cursor\logs\
Tools not appearing:
Verify MCP server is enabled in Cursor IDE settings
Check server logs for errors
Try disabling and re-enabling the server
Unity integration not working:
Ensure Unity Editor is running
Verify Unity project path is correct
Check
unity3d-mcpserver is healthy
🤝 Contributing
Contributions welcome! Please see CONTRIBUTING.md for guidelines.
📄 License
MIT License - see LICENSE for details.
🙏 Acknowledgments
FastMCP framework
ROS community
Unity3D, VRChat, World Labs Marble/Chisel
MCP ecosystem contributors
Status: ✅ ALPHA - Cursor Integration Working - Core robotics-mcp functionality operational, mounted servers temporarily disabled for stability
⏸️ MCP Server Composition: Currently runs standalone. Integration with osc-mcp, unity3d-mcp, vrchat-mcp, avatar-mcp, blender-mcp, gimp-mcp planned for future releases.