AI MCP System
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@AI MCP Systemfind documents about LangGraph agent setup"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
AI MCP System
An intelligent, Model Context Protocol (MCP) compatible Retrieval-Augmented Generation (RAG) backend utilizing LangGraph and FastAPI.
This system allows seamless chaining of AI model logic (powered by Groq APIs) and document context search abilities via HuggingFace embedding configurations and a FAISS local vector database.
š Features
ReAct Agent Flow Setup: Custom autonomous routing utilizing LangGraph state machines.
Dynamic RAG Pipeline: Secure and optimized ingestion, chunking, and semantic vector searching.
Persisted Thread Memory: SQLite integrated transactions storing continuous session context tracking.
Fully Modular Architecture: Easily scalable with new LangGraph agents and standalone MCP wrappers.
Container Ready: Ships with explicit configurations targeting lightweight reproducible Python Docker builds.
Related MCP server: Modular RAG System
š Prerequisites
Before running the backend, make sure you have installed:
Python 3.11+
Create a Groq API Key: https://console.groq.com/keys
š ļø Installation
1. Clone the repository
git clone https://github.com/venkatanaveen2078909-rgb/MCP-server.git
cd MCP-server2. Activate a local Virtual Environment (Recommended)
# On Windows
python -m venv venv
venv\Scripts\activate3. Install Dependencies
pip install -r requirements.txt4. Create Environment Variables
Create a .env file inside the root directory:
GROQ_API_KEY=your_groq_api_key_here5. Start the Application
uvicorn main:app --reloadThe server will now be live at: š http://127.0.0.1:8000
ā³ Note: On first startup, it may take ~60 seconds to download HuggingFace embedding models (~80MB).
š API Usage (Swagger UI)
Access the interactive API docs: š http://127.0.0.1:8000/docs
Available Endpoints
GET /ā Server health checkPOST /api/chat/chatā Send input to ReAct agent (Groq + RAG context)POST /api/rag/queryā Query FAISS vector database
š³ Docker
Build and run the backend using Docker:
docker build -t ai-mcp-system .
docker run -p 8000:8000 ai-mcp-systemš Notes
Ensure
.envis correctly configured before running.First-time setup requires internet for model downloads.
Easily extendable with additional LangGraph agents and MCP integrations.
Related MCP Connectors
DocBase MCP server for AI agents
MCP-Native LLM Orchestration Agent
LLM Orchestration Agent (Mcp)
Related MCP Servers
- AlicenseNot gradedqualityBmaintenanceMCP server providing persistent memory, semantic search, versioned storage, webhook fanout, and unified LLM routing for AI agents via FastAPI runtime with multiple backend options.31Apache 2.0
- FlicenseNot gradedqualityBmaintenanceMCP server for a modular RAG system that enables natural language question answering over enterprise documents with intent-aware routing, adaptive retrieval, and citation-backed responses.-
- AlicenseNot gradedqualityBmaintenanceA minimal RAG service that exposes a vector index for document retrieval via REST and MCP, allowing querying for relevant document chunks and returning a suggested LLM prompt.MIT
- FlicenseNot gradedqualityCmaintenanceAn MCP server for document parsing, ingestion, query (including multimodal), and lightweight knowledge graph inspection, enabling RAG workflows via the Model Context Protocol.-