Robotics MCP Server

# 🚀 Robotics MCP Platform - Complete Installation Guide ## Overview The Robotics MCP Platform is a comprehensive robotics development environment that integrates physical robotics, virtual worlds, AI-powered control systems, and creative tools. This guide covers the complete setup process for all required software and hardware components. --- ## 📋 System Requirements ### Minimum Hardware Requirements - **CPU**: Intel i5-12600K / AMD Ryzen 5 5600X or better - **RAM**: 32GB DDR4-3200 or better - **GPU**: NVIDIA RTX 4070 (12GB VRAM) or better - **Storage**: 500GB NVMe SSD + 2TB HDD for datasets - **OS**: Windows 11 Pro (64-bit) - **Network**: Stable 100Mbps+ internet connection ### Recommended Hardware - **CPU**: Intel i7-13700K / AMD Ryzen 7 7700X - **RAM**: 64GB DDR5-5600 - **GPU**: NVIDIA RTX 4080/4090 (16GB+ VRAM) - **Storage**: 1TB NVMe Gen4 SSD + 4TB HDD - **Display**: 4K monitor for detailed 3D work --- ## 🛠️ Core Development Environment ### 1. IDE Setup (Choose One) #### Option A: Cursor IDE (Recommended) ```bash # Download and install Cursor # Visit: https://cursor.sh/ # Alternative: https://cursor.com/ # Install recommended extensions: # - Python (Microsoft) # - TypeScript/JavaScript # - Unity (Visual Studio Marketplace) # - Blender Development (Jacques Lucke) # - Docker (Microsoft) ``` #### Option B: Antigravity IDE ```bash # Download from: https://antigravity.xyz/ # Follow setup wizard for robotics development profile ``` ### 2. Python Environment Setup ```bash # Install Python 3.11+ (required for FastAPI compatibility) # Download from: https://python.org/downloads/ # Create virtual environment python -m venv robotics-env robotics-env\Scripts\activate # Install core dependencies pip install fastapi uvicorn[standard] pydantic python-socketio aiohttp pip install opencv-python pillow numpy requests python-dotenv pip install openai anthropic # Verify installation python -c "import fastapi, uvicorn; print('✅ Python environment ready')" ``` --- ## 🎨 Creative Tools Suite ### 3. Unity3D Setup **Required Version**: Unity 2022.3 LTS or newer ```bash # Download Unity Hub from: https://unity.com/download # Install Unity Hub and create account # Install Unity Editor: # - Unity 2022.3.16f1 (LTS) # - Add modules: Android Build Support, Windows Build Support # Install Unity packages: # - Universal Render Pipeline (URP) # - Input System # - Cinemachine # - TextMeshPro ``` **Purpose**: 3D environment creation, robot simulation, VR integration ### 4. Blender Setup **Required Version**: Blender 4.0+ ```bash # Download from: https://blender.org/download/ # Install Blender 4.0+ (LTS recommended) # Install add-ons: # - Go to Edit > Preferences > Add-ons # - Install: Node Wrangler, LoopTools, BoolTool # - Enable: Import-Export: FBX format, OBJ format # Optional: Install gsplat-unity plugin for Gaussian splat import ``` **Purpose**: 3D modeling, robot prototyping, environment assets ### 5. GIMP Setup **Required Version**: GIMP 2.10.34+ ```bash # Download from: https://gimp.org/downloads/ # Install with all optional components # Recommended plugins: # - Resynthesizer (content-aware fill) # - Liquid Rescale # - G'MIC (effects and filters) ``` **Purpose**: Texture creation, image processing for robot vision ### 6. VRChat (PCVR) Setup **Required Version**: Latest PC version ```bash # Download VRChat from Steam: https://store.steampowered.com/app/438100/VRChat/ # System Requirements: # - VR Headset: Meta Quest 2/3/Pro, Valve Index, HTC Vive # - Minimum: GTX 1060 / RX 580 # - Recommended: RTX 3070 / RX 6700 XT # Create VRChat account and complete setup wizard # Join robotics/developer communities for testing ``` **Purpose**: Virtual reality testing environment, social robotics simulation --- ## 🤖 MCP Servers Setup ### 7. Core MCP Server Installation ```bash # Clone the MCP servers repository cd D:\Dev\repos git clone https://github.com/your-org/mcp-servers.git # Install each server: cd mcp-servers # Blender MCP Server cd blender-mcp pip install -r requirements.txt # Configure Blender path in config.json # GIMP MCP Server cd ../gimp-mcp pip install -r requirements.txt # Configure GIMP executable path # Unity MCP Server cd ../unity-mcp pip install -r requirements.txt # Configure Unity Editor path # VRChat MCP Server cd ../vrchat-mcp pip install -r requirements.txt # Configure VRChat SDK paths # Robotics MCP Server (this repo) cd ../robotics-mcp pip install -r requirements.txt ``` ### 8. MCP Server Configuration ```json // config/mcp-servers.json { "servers": { "blender": { "command": "python", "args": ["-m", "blender_mcp.server"], "env": { "BLENDER_PATH": "C:\\Program Files\\Blender Foundation\\Blender 4.0\\blender.exe" } }, "gimp": { "command": "python", "args": ["-m", "gimp_mcp.server"], "env": { "GIMP_PATH": "C:\\Program Files\\GIMP 2\\bin\\gimp-2.10.exe" } }, "unity": { "command": "python", "args": ["-m", "unity_mcp.server"], "env": { "UNITY_PATH": "C:\\Program Files\\Unity\\Hub\\Editor\\2022.3.16f1\\Editor\\Unity.exe" } } } } ``` --- ## 🌐 AI & Cloud Services ### 9. WorldLabs.ai Account Setup **Cost**: €35/month (not free) ```bash # Visit: https://worldlabs.ai # Create account and select Marble subscription # Install WorldLabs SDK: pip install worldlabs-sdk # Configure API keys: # Create .env file in project root echo "WORLDLABS_API_KEY=your_api_key_here" > .env echo "WORLDLABS_PROJECT_ID=your_project_id" >> .env # Test connection: python -c "import worldlabs; print('✅ WorldLabs connected')" ``` **Purpose**: Gaussian splat generation, 3D world creation, AI-powered environment modeling ### 10. Niantic iPhone App Setup ```bash # Download from App Store: "Niantic" or specific app # Create account and link to main account # Enable location services and camera permissions # Configure for robotics data collection # Optional: Set up Niantic SDK integration pip install niantic-sdk # If available ``` **Purpose**: Real-world mapping data, location-based robotics testing ### 11. Escape.ai Setup (Optional - Fan Feature) ```bash # Visit: https://escape.ai # Create account (check current pricing) # Install desktop app if available # For Gaeta fan features: # Enable experimental AI features # Configure for creative robotics projects ``` **Purpose**: AI-powered creative tools, experimental features --- ## 🔧 Hardware Integration ### 12. Robot Hardware (Optional but Recommended) #### Option A: Commercial Robot - **Pilot Labs Scout E**: Tank tracks, waterproof, perimeter patrol - **Boston Dynamics Spot**: Advanced mobility (expensive) - **ANYbotics ANYmal**: Rough terrain navigation #### Option B: DIY Robot Platform - **Raspberry Pi 4/5** with servo controllers - **Arduino Mega** for motor control - **Jetson Nano/Orin** for AI processing - **ESP32** for wireless communication #### Option C: Modify Existing Toys - **Petboot Loona**: Reverse engineer and upgrade - **WowWee Robotics**: Hack existing consumer robots ```bash # For USB camera integration (already configured): # Connect any USB webcam # System will auto-detect and stream at http://localhost:3000 ``` ### 13. Charge Point Infrastructure ```bash # For unattended robot operation: # Install smart power outlets (TP-Link Tapo) # Configure automated charging schedules # Set up power monitoring and alerts ``` --- ## 🚀 Platform Installation & Startup ### 14. Final Setup Steps ```bash # Clone the main repository cd D:\Dev\repos git clone https://github.com/your-org/robotics-webapp.git cd robotics-webapp # Install dependencies pip install -r backend/requirements.txt cd src && npm install # Configure environment variables cp .env.example .env # Edit .env with your API keys and paths # Start the platform # Backend (with watchfiles): cd backend python main.py # Frontend (in new terminal): cd .. npm run dev # Access at: http://localhost:3000 ``` ### 15. Verification Checklist - [ ] Unity3D installed and configured - [ ] Blender 4.0+ with required add-ons - [ ] GIMP with recommended plugins - [ ] VRChat PC version installed - [ ] All MCP servers running - [ ] NVIDIA RTX 4070+ detected - [ ] Cursor/Antigravity IDE configured - [ ] WorldLabs.ai account active - [ ] Niantic app configured - [ ] USB camera connected (optional) - [ ] Platform accessible at localhost:3000 --- ## 🔧 Troubleshooting ### Common Issues **"GPU not detected"** ```bash # Verify GPU nvidia-smi # Update NVIDIA drivers # Visit: https://nvidia.com/drivers ``` **"MCP server connection failed"** ```bash # Check server logs tail -f logs/mcp-server.log # Verify configuration python -m json.tool config/mcp-servers.json ``` **"WorldLabs API error"** ```bash # Check API key echo $WORLDLABS_API_KEY # Test connection curl -H "Authorization: Bearer $WORLDLABS_API_KEY" https://api.worldlabs.ai/health ``` --- ## 📚 Additional Resources - **Documentation**: `docs/` directory - **API Reference**: http://localhost:8354/docs (when running) - **Community**: Discord/VRChat robotics channels - **Support**: GitHub Issues --- ## ⚠️ Important Notes - **WorldLabs.ai** requires a paid subscription (€35/month) - **Hardware robots** are optional but enhance the experience - **VRChat** requires compatible VR hardware - **All MCP servers** must be running for full functionality - **GPU requirements** are strict for AI features **Ready to build the future of robotics! 🤖✨**