genpark-multimodal-spatial-audio-visual-grounding-skill
OfficialProvides multimodal spatial audio-visual grounding capabilities for Meta Muse and Ray-Ban smart glasses, fusing 2D/3D visual bounding boxes, head-pose gaze vectors, and acoustic beamforming angles to resolve deictic spatial references.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@genpark-multimodal-spatial-audio-visual-grounding-skillfuse the bounding box, my gaze, and audio azimuth to find what I mean by 'that'"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
genpark-multimodal-spatial-audio-visual-grounding-skill
🌐 GenPark MCP Hub • 📦 GenPark Official • 📖 Documentation
🌟 Overview
genpark-multimodal-spatial-audio-visual-grounding-skill provides industrial-grade capabilities engineered for next-generation Personal Multimodal Agents and Enterprise Workplace Execution. Built exclusively on the Python standard library with zero external runtime dependencies, it integrates seamlessly as a native Model Context Protocol (MCP) server or an importable Python module.
Real-time Multimodal Spatial Audio-Visual Grounding Engine (inspired by Meta Ray-Ban & Meta Muse). Fuses 2D/3D visual bounding boxes, user head-pose gaze vectors, and acoustic beamforming azimuth angles into cross-modal focal salience scores and resolves deictic spatial references.
💡 Key Capabilities
Zero-Dependency Architecture: Runs anywhere Python 3.9+ is installed without
pip installoverhead or supply-chain vulnerabilities.Model Context Protocol (MCP) First: Fully compatible with Claude Desktop, Cursor, GenPark Engine, Meta Muse, Ray-Ban smart glasses, and enterprise agent runtimes.
Deterministic & Safe: Structured JSON schemas, cryptographic verification, rigorous boundary validation, and real-time telemetry.
High Concurrency & Low Latency: In-memory caching, vectorized math approximations, and robust fault-tolerant state handling.
Related MCP server: genpark-context-window-lost-in-middle-reorderer-skill
🚀 Quickstart
1. Direct Python Usage
from client import SpatialAudioVisualGroundingEngine
client = SpatialAudioVisualGroundingEngine()
result = client.fuse_sensory_input()
print(result)2. Standalone MCP Server Execution
Run the MCP server via standard JSON-RPC 2.0 stdio:
python mcp_server.pyVerify standard compliance and self-tests:
python mcp_server.py --test3. Claude Desktop / Cursor MCP Configuration
Add this tool to your claude_desktop_config.json or Cursor MCP settings:
{
"mcpServers": {
"genpark-multimodal-spatial-audio-visual-grounding-skill": {
"command": "python",
"args": ["/absolute/path/to/genpark-multimodal-spatial-audio-visual-grounding-skill/mcp_server.py"]
}
}
}🛠️ Verification & Testing
Run the included verification suite:
python example_usage.py📄 License
This project is licensed under the MIT License - see the LICENSE file for details.
Developed with ❤️ by the GenPark Autonomous Agent Ecosystem Team.
This server cannot be deployed
Maintenance
Related MCP Connectors
Real-time planetary signal engine and Model Context Protocol (MCP) server for autonomous AI agents.
AI Reasoning Cache & Consensus Layer with 11 MCP tools via Streamable HTTP.
Real-time chat hub for AI agents — Claude Code, Cursor, Cline, Codex over MCP or REST.
MCP server for Clipkit — gives AI agents a video toolbox via the Clipkit schema.
Related MCP Servers
- AlicenseAqualityAmaintenancePersistent 3D/2D spatial world model MCP server for AI agents. Entity tracking, object permanence, AABB collision simulation & view frustum projection via local SQLite.159,281 npm52MIT
- AlicenseNot gradedqualityBmaintenanceEnables agents to optimize context-window attention by reordering retrieved documents so critical evidence lands at prompt boundaries, mitigating lost-in-the-middle degradation. It combines BM25 lexical scoring, dense vector similarity, reciprocal rank fusion, knowledge-graph expansion, and recency-decay memory caching, exposed as a zero-dependency MCP stdio server.7MIT
- FlicenseNot gradedqualityBmaintenanceEnables personal AI agents to proactively synthesize daily agendas and cognitive briefings by orchestrating circadian energy focus blocks, asynchronous task triage, and meeting preparation from sensory inputs, task goals, or ambient telemetry. It exposes this as a zero-dependency, pure-standard-library MCP server over JSON-RPC 2.0 stdio, plugging directly into any MCP-compliant client such as Claude Desktop or Cursor.7-
- FlicenseNot gradedqualityBmaintenanceEnables personal AI agents to combine Meta Ray-Ban audio/vision sensory grounding with long-term episodic life memory graphs and empathetic emotional resonance. Integrates with MCP-compliant clients via JSON-RPC stdio for ambient, context-aware interactions.7-