Provides tools for managing Kubernetes environments, including listing pods, retrieving pod logs, and scaling deployments.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@MCP Platformscale the api-server deployment to 3 replicas"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
MCP Platform
A scalable MCP-based execution platform that allows users to interact via a chat UI, with an LLM (via LlamaIndex) interpreting intent and controlled execution of application-specific actions via MCP.
Architecture Overview
┌─────────────┐
│ Chat UI │ React-based frontend
└──────┬──────┘
│
▼
┌─────────────────────────────┐
│ Orchestrator (AI Gateway) │ FastAPI - Conversation management, LLM orchestration
└──────┬──────────────────────┘
│
├────────────────────┐
▼ ▼
┌─────────────┐ ┌─────────────┐
│ LLM │ │ MCP Client │
│ (LlamaIndex)│ │ │
└─────────────┘ └──────┬──────┘
│
▼
┌─────────────┐
│ MCP Server │ Tool registry, auth, audit, routing
└──────┬──────┘
│
┌─────────────────┼─────────────────┐
▼ ▼ ▼
┌───────────┐ ┌───────────┐ ┌───────────┐
│ HR │ │ ERP │ │ DevOps │
│ Domain │ │ Domain │ │ Domain │
└───────────┘ └───────────┘ └───────────┘Key Principles
Separation of Concerns: Each component has a single responsibility
Domain Isolation: Applications are isolated with no cross-domain calls
Configuration-Driven: New domains added via configuration, not code changes
LLM is Advisory, MCP is Authoritative: LLM suggests actions, MCP enforces them
Components
Frontend (Chat UI)
Captures user input
Displays assistant responses
No business logic
No direct LLM or MCP access
Orchestrator (AI Gateway)
Manages conversation state
Interfaces with LLM via LlamaIndex
Supplies tool definitions to LLM
Parses structured tool calls
Invokes MCP Client
MCP Server
Registers and exposes MCP tools
Enforces authorization
Routes calls to application domains
Audits all executions
No LLM or UI logic
Application Domains
Each domain contains:
Tool definitions (namespaced, e.g.,
hr.get_employee)Adapter implementation
Permission model
Configuration
Included domains:
HR: Employee lookup, department info
ERP: Invoices, inventory management
DevOps: Kubernetes operations, logs, scaling
Quick Start
Prerequisites
Python 3.10+
Node.js 18+
Docker (optional)
Local Development
Clone and setup:
cd mcp_poc
cp .env.example .env
# Edit .env with your LLM API keysInstall Python dependencies:
pip install -e ".[dev]"Start MCP Server (terminal 1):
export PYTHONPATH=$PWD/src
python -m mcp_server.mainStart Orchestrator (terminal 2):
export PYTHONPATH=$PWD/src
python -m orchestrator.mainStart Frontend (terminal 3):
cd frontend
npm install
npm run devOpen browser: http://localhost:3000
Using Docker
# Build and run all services
docker-compose up --build
# Access:
# - Frontend: http://localhost:3000
# - Orchestrator API: http://localhost:8000
# - MCP Server API: http://localhost:8001Testing with Mock LLM
For testing without LLM API keys, use the mock provider:
# config/settings.yaml
llm:
provider: mockAPI Endpoints
Orchestrator (port 8000)
Endpoint | Method | Description |
| GET | Health check |
| POST | Send chat message |
| GET | List conversations |
| GET | Get conversation history |
| DELETE | Delete conversation |
| GET | List available tools |
MCP Server (port 8001)
Endpoint | Method | Description |
| GET | Health check |
| GET | List registered tools |
| GET | Get tool details |
| POST | Execute a tool |
| GET | List registered domains |
Tool Examples
HR Domain
# Get employee information
hr.get_employee(employee_id="E001")
# Search employees
hr.search_employees(department="Engineering", query="developer")
# List departments
hr.list_departments()ERP Domain
# Get invoice
erp.get_invoice(invoice_id="INV-001")
# Create invoice
erp.create_invoice(
customer="Acme Corp",
items=[{"description": "Service", "quantity": 1, "unit_price": 1000}]
)
# Check low stock
erp.check_low_stock(category="Components")DevOps Domain
# List pods
devops.list_pods(namespace="production")
# Get pod logs
devops.get_pod_logs(pod_name="api-server-xyz")
# Scale deployment
devops.scale_deployment(deployment_name="api-server", replicas=3)Adding a New Domain
Create domain directory:
src/domains/mydomain/
├── __init__.py
└── config.yaml (optional)Implement adapter:
# src/domains/mydomain/__init__.py
from domains.base import BaseAdapter
from shared.models import DomainConfig, ToolDefinition
class MyDomainAdapter(BaseAdapter):
def __init__(self, config: DomainConfig):
super().__init__(config)
self._define_tools()
def _define_tools(self):
self._tools["my_action"] = ToolDefinition(
name="my_action",
domain="mydomain",
description="Does something useful",
input_schema={...},
output_schema={...}
)
@property
def tools(self):
return list(self._tools.values())
def execute(self, action, parameters, context):
# Implement action handlers
...
def register_mydomain_domain(router):
config = DomainConfig(name="mydomain", ...)
adapter = MyDomainAdapter(config)
from mcp_server.registry import get_registry
get_registry().register_many(adapter.tools)
router.register_adapter("mydomain", adapter.execute)Register in
domains/__init__.py:
from domains.mydomain import register_mydomain_domain
def load_all_domains(router):
# ... existing domains ...
register_mydomain_domain(router)Add configuration (optional):
# config/domains/mydomain.yaml
name: mydomain
description: My custom domain
version: "1.0.0"
enabled: trueConfiguration
Environment Variables
Variable | Description | Default |
| Environment name | development |
| Log level | INFO |
| LLM provider | azure_openai |
| API key for LLM | - |
| API base URL | - |
| Model name | gpt-4 |
| MCP Server port | 8001 |
| Orchestrator port | 8000 |
YAML Configuration
See config/settings.yaml for full configuration options.
Security
Authentication
User identity originates in Orchestrator
MCP Server trusts only authenticated MCP Clients
JWT-based token authentication
Authorization
Enforced in MCP Server
Never decided by the LLM
Role-based and scope-based access control
Auditing
All tool executions are logged
Captures: user, tool, parameters, timestamp, result
Sensitive parameters are automatically redacted
Testing
# Run all tests
pytest
# Run with coverage
pytest --cov=src --cov-report=html
# Run specific test file
pytest tests/test_domains.py
# Run specific test
pytest tests/test_mcp_server.py::TestToolRegistry::test_register_toolProject Structure
mcp_poc/
├── src/
│ ├── shared/ # Shared models, config, utilities
│ │ ├── models.py # Pydantic models
│ │ ├── config.py # Configuration management
│ │ ├── logging.py # Structured logging
│ │ └── schema.py # JSON Schema utilities
│ ├── mcp_server/ # MCP Server
│ │ ├── main.py # FastAPI app
│ │ ├── registry.py # Tool registry
│ │ ├── router.py # Tool routing
│ │ ├── auth.py # Authentication/Authorization
│ │ └── audit.py # Audit logging
│ ├── mcp_client/ # MCP Client
│ │ ├── client.py # HTTP client
│ │ └── discovery.py # Tool discovery with caching
│ ├── orchestrator/ # AI Gateway
│ │ ├── main.py # FastAPI app
│ │ ├── llm.py # LLM providers (LlamaIndex)
│ │ ├── conversation.py # Conversation management
│ │ └── gateway.py # Core orchestration logic
│ └── domains/ # Application domains
│ ├── base.py # Base adapter classes
│ ├── hr/ # HR domain
│ ├── erp/ # ERP domain
│ └── devops/ # DevOps domain
├── frontend/ # React chat UI
│ ├── src/
│ │ ├── App.tsx # Main component
│ │ └── services/api.ts # API client
│ └── package.json
├── config/ # Configuration files
│ ├── settings.yaml # Main config
│ └── domains/ # Domain configs
├── tests/ # Test suite
├── docker-compose.yml # Docker orchestration
├── Dockerfile # Backend container
└── pyproject.toml # Python project configSuccess Criteria
✅ New applications onboarded via new domain only
✅ No core redeployment for extensions
✅ LLM provider swappable without MCP changes
✅ Safe coexistence of multiple applications
✅ Domain isolation by design
✅ Configuration-driven extensibility
License
MIT License - see LICENSE for details.
This server cannot be installed
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.