The Robotics MCP Server provides unified control for both physical robots (Moorebot Scout, Unitree Go2/G1 via ROS) and virtual robots (in Unity, VRChat, Resonite) through a single interface.
Core Capabilities:
System Management: Get comprehensive help, check server status with health monitoring, and list all robots with filtering by type and physical/virtual status.
Robot Control & Movement: Control movement with linear/angular velocities, emergency stop, return to dock, and execute specific poses (stand, sit, walk gaits for Unitree). Sync virtual robots with physical robot states in real-time.
Virtual Robot Lifecycle (CRUD): Create, read, update, delete, and list virtual robots (vbots) with support for Scout, Scout E, Go2, G1, Robbie, and custom models. Update properties including position, scale, and metadata.
3D Model Management: Create robot models from scratch using Blender MCP, import/export models to/from game engines, and convert between formats (FBX, GLB, OBJ, VRM). Generate textures using GIMP MCP with realistic/stylized/simple styles.
Animation Control: Control wheel rotation for mecanum robots, play movement animations (walk, turn, idle), set poses, play custom animations with speed/loop controls, and query animation states.
Camera & Vision: Access live camera feeds from physical robots, get virtual camera views, adjust camera angles (pitch/yaw), capture still images, and manage video streaming.
Navigation & Path Planning: Plan paths using A* or RRT algorithms, execute planned paths with real-time following, set/clear waypoints for multi-point navigation, implement dynamic obstacle avoidance, and query navigation status.
Environment Management: Load environments from World Labs Marble/Chisel generators, get virtual LiDAR scans using Unity physics raycasting, and test navigation in virtual environments.
File Conversion: Convert Adobe .spz compressed files to .ply or .splat formats for Unity integration and extract metadata.
Hardware Integration: Support for LiDAR sensors (YDLIDAR SuperLight, Livox Mid-360), microcontrollers (Raspberry Pi Pico, ESP32, Arduino Nano), and pyroelectric motion sensors (AM312, HC-SR501).
Technical Features: Dual transport modes (stdio MCP protocol and HTTP FastAPI endpoints), ROS 1.4 Melodic integration via rosbridge_suite, mock mode for testing without hardware, multi-robot coordination, and composition of 6+ specialized MCP servers (osc-mcp, unity3d-mcp, vrchat-mcp, avatar-mcp, blender-mcp, gimp-mcp).
Enables automated 3D robot model creation and geometry generation for robotics applications
Provides texture creation and image processing capabilities for robot model development
Integrates with ROS 1.4 (Melodic) via rosbridge_suite for physical robot control, including Moorebot Scout and Unitree robots
Enables virtual robot instantiation, environment loading, and robot model import in Unity3D projects
Provides virtual robot control and integration capabilities within VRChat environments
Robotics MCP Server
Unified robotics control via MCP - Physical and virtual robots (bot + vbot)
โ ๏ธ Important: Alpha Status & Dependencies
This server is in ALPHA and requires multiple composited MCP servers to function:
Required MCP Servers:
osc-mcp,unity3d-mcp,vrchat-mcp,avatar-mcp,blender-mcp,gimp-mcpStatus: Active development - features may change, break, or be incomplete
Virtual Robotics: Prioritized (vbot) - physical robot support coming after hardware arrives (XMas 2025)
MCP Server Composition: This server composes 6+ MCP servers - all must be properly configured and running
See MCP Server Dependencies section for setup details.
๐ฏ Overview
Robotics MCP Server provides unified control for both physical robots (ROS-based) and virtual robots (Unity/VRChat), with a focus on Moorebot Scout, Unitree robots, and virtual robotics testing.
๐ Project Stats: ~9,200 lines of code, ~2,600 lines of tests, ~4,100 lines of documentation
โ ๏ธ ALPHA STATUS - ONGOING DEVELOPMENT: This server is in active development and requires multiple composited MCP servers to function properly. See MCP Server Dependencies below.
Key Features
Physical Robot Control: Moorebot Scout (ROS 1.4), Unitree Go2/G1
YDLIDAR SuperLight (95g) LiDAR integration for Scout
Virtual Robot Control: Unity3D/VRChat/Resonite integration via existing MCP servers
ROS Bridge Integration: Robot Operating System 1.4 (Melodic) via rosbridge_suite
LiDAR Sensing: Affordable 3D LiDAR Guide - Livox Mid-360 ($399), RPLIDAR ($99), and more
Tiny Controllers: Pico & Micro Boards - Raspberry Pi Pico, ESP32, Arduino Nano for small robots
Motion Detection: Pyroelectric Sensors Guide - AM312, HC-SR501 ultra-small PIR sensors ($1-5)
Multi-Robot Coordination: Physical and virtual robots together
World Labs Marble/Chisel: Environment generation and import
Dual Transport: stdio (MCP) + HTTP (FastAPI) endpoints
MCP Server Composition: Integrates with
osc-mcp,unity3d-mcp,vrchat-mcp,avatar-mcp,blender-mcp,gimp-mcpRobot Model Creation: Automated 3D model creation using
blender-mcp(geometry) +gimp-mcp(textures)
๐ Documentation
AI Research Workflow ๐ง Architect first: AI-powered research methodology for all development
Vienna Technical Museum Makerspace ๐ ๏ธ Fantastic makerspace - free equipment, pay only consumables!
Progress Report ๐ Comprehensive project status and achievements!
Unity Vbot Instantiation Guide - Complete guide for instantiating virtual robots in Unity3D with proper terminology
๐ Quick Start
Installation
MCP Server Dependencies
โ ๏ธ CRITICAL: This server requires multiple composited MCP servers to function. You must install and configure all of the following:
Required MCP Servers:
osc-mcp: OSC communication for real-time robot controlunity3d-mcp: Unity3D integration for virtual roboticsvrchat-mcp: VRChat integration for social VR testingavatar-mcp: Avatar management and animationblender-mcp: 3D model creation (geometry)gimp-mcp: Texture creation and image processing
Setup Steps:
Install each MCP server in your Claude Desktop/Cursor IDE configuration
Ensure all servers are enabled and running
Configure
robotics-mcpto use the correct prefixes (see Configuration below)Verify connectivity using
robotics_system(operation="status")tool
Troubleshooting:
If tools fail, check that all required MCP servers are enabled
Use
robotics_system(operation="status")to verify mounted server connectivitySee MCP Integration for detailed setup
Configuration
Create configuration file at ~/.robotics-mcp/config.yaml:
Running the Server
stdio Mode (MCP Protocol)
HTTP Mode (FastAPI)
Dual Mode (Both stdio + HTTP)
๐ ๏ธ Usage
MCP Tools
Robot Control
Virtual Robotics
Robot Model Tools
HTTP API
Health Check
List Robots
Control Robot
List Tools
Call Tool
๐ Documentation
ROS Fundamentals ๐ค Complete guide to the Robot Operating System - what ROS is, why it matters, core concepts, and ROS 1 vs ROS 2
LiDAR Guide ๐ก Affordable 3D sensing - Livox Mid-360 ($399), RPLIDAR ($99), integration, and robotics applications
Tiny Controllers Guide ๐ฎ Smallest microcontroller boards for robotics - Raspberry Pi Pico, ESP32, Arduino Nano, Teensy
Pyroelectric Sensors Guide ๐ Ultra-small motion detection - AM312 (6x4.5mm), HC-SR501, PIR sensors ($1-5)
Component Reuse Hacks ๐ง Creative electronics salvage - Philips Hue bulbs, HDD motors, smartphone cameras
World Labs Unity Integration Fix ๐ Resolve Marble .spz to Unity splat format incompatibilities + Scout vbot improvements
Import Nekomimi-chan VRM Guide ๐ฑ High-priority VRM avatar import for VRoid Studio model in avatar-mcp
Blender VRM Workflow for Robotics ๐ง Create custom VRM models for dogbots, diggers, articulated arms despite humanoid limitations
VRM Tools Alternatives ๐จ More generalized VRM creation tools beyond VRoid Studio for robots and non-humanoids
Comprehensive Project Notes ๐ Complete project documentation!
VRM vs Robot Models ๐ค VRM format guide - when to use VRM vs FBX/GLB
Unity Vbot Instantiation Guide ๐ฎ Complete guide for instantiating virtual robots in Unity3D
Quick Start: VRChat โก Get Scout into VRChat!
ROS 1.4 Local Setup ๐ณ Full local ROS environment for Scout!
VRChat Scout Setup - Complete guide
๐งช Testing
Comprehensive test suite: 21 test files, 2,642 lines of tests covering all 11 tools!
๐ง Development
Project Structure
Code Quality
๐ง Troubleshooting
MCP Server UI Desync (Critical for Composite Servers)
Problem: Cursor IDE UI shows "error, no tools" for MCP servers, but the server process is running fine. This is critical for robotics-mcp because it composes 6+ MCP servers - if ANY desyncs, the entire workflow breaks.
Symptoms:
Cursor IDE shows "error, no tools" for one or more MCP servers
Agent silently fails when trying to use robotics-mcp tools
Workflow breaks without clear error message
Quick Fix:
Open Cursor IDE Settings โ Features โ Model Context Protocol
For each server showing "error, no tools": Disable โ Enable
Wait ~5-10 seconds for reconnection
Verify tools appear
Health Check:
Automated Fix:
Full Documentation:
Other Issues
Server won't start:
Check Python version:
python --version(requires 3.10+)Verify dependencies:
pip install -e ".[dev]"Check logs:
C:\Users\sandr\AppData\Roaming\Cursor\logs\
Tools not appearing:
Verify MCP server is enabled in Cursor IDE settings
Check server logs for errors
Try disabling and re-enabling the server
Unity integration not working:
Ensure Unity Editor is running
Verify Unity project path is correct
Check
unity3d-mcpserver is healthy
๐ค Contributing
Contributions welcome! Please see CONTRIBUTING.md for guidelines.
๐ License
MIT License - see LICENSE for details.
๐ Acknowledgments
FastMCP framework
ROS community
Unity3D, VRChat, World Labs Marble/Chisel
MCP ecosystem contributors
Status: โ ๏ธ ALPHA - Ongoing Development - Virtual robotics (vbot) prioritized, physical robot support coming after hardware arrives (XMas 2025)
โ ๏ธ Requires Multiple MCP Servers: This server composes 6+ MCP servers (osc-mcp, unity3d-mcp, vrchat-mcp, avatar-mcp, blender-mcp, gimp-mcp) - all must be properly configured and running for full functionality.