Agentic RAG MCP Server
Provides tools for entity extraction, query refinement, and relevance checking using OpenAI to enhance retrieval-augmented generation.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Agentic RAG MCP ServerExtract entities from: 'AI trends in healthcare 2025'"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
🚀 Agentic RAG with MCP Server [
]
✨ Overview

Agentic RAG with MCP Server is a powerful project that brings together an MCP (Model Context Protocol) server and client for building Agentic RAG (Retrieval-Augmented Generation) applications.
This setup empowers your RAG system with advanced tools such as:
🕵️♂️ Entity Extraction
🔍 Query Refinement
✅ Relevance Checking
The server hosts these intelligent tools, while the client shows how to seamlessly connect and utilize them.
Related MCP server: Agentic RAG with MCP Server
🖥️ Server — server.py
Powered by the FastMCP class from the mcp library, the server exposes these handy tools:
Tool Name | Description | Icon |
| Returns the current date & time | ⏰ |
| Uses OpenAI to extract entities from a query — enhancing document retrieval relevance | 🧠 |
| Improves the quality of user queries with OpenAI-powered refinement | ✨ |
| Filters out irrelevant content by checking chunk relevance with an LLM | ✅ |
🤝 Client — mcp-client.py
The client demonstrates how to connect and interact with the MCP server:
Establish a connection with
ClientSessionfrom themcplibraryList all available server tools
Call any tool with custom arguments
Process queries leveraging OpenAI or Gemini and MCP tools in tandem
⚙️ Requirements
Python 3.9 or higher
openaiPython packagemcplibrarypython-dotenvfor environment variable management
🛠️ Installation Guide
# Step 1: Clone the repository
git clone https://github.com/ashishpatel26/Agentic-RAG-with-MCP-Server.git
# Step 2: Navigate into the project directory
cd Agentic-RAG-with-MCP-Serve
# Step 3: Install dependencies
pip install -r requirements.txt🔐 Configuration
Create a
.envfile (use.env.sampleas a template)Set your OpenAI model in
.env:
OPENAI_MODEL_NAME="your-model-name-here"
GEMINI_API_KEY="your-model-name-here"🚀 How to Use
Start the MCP server:
python server.pyRun the MCP client:
python mcp-client.py📜 License
This project is licensed under the MIT License.
Thanks for Reading
This server cannot be deployed
Maintenance
Related MCP Connectors
MCP server for building and testing AI agents with multi-model experimentation and insights.
Cloud or self-hosted knowledge for AI agents: hybrid search, reranking, GraphRAG, scoped MCP tools.
The CustomGPT.ai MCP server is a fully managed, RAG-powered endpoint that connects large language models with private knowledge bases and external data sources. It provides tools for retrieval-augmented generation queries (send_message), data ingestion (upload_file), and source listing, enabling AI agents to query private documents like PDFs with high accuracy and real-time citations.
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceA server exposing intelligent tools for enhancing RAG applications with entity extraction, query refinement, and relevance checking capabilities.35-
- FlicenseNot gradedqualityDmaintenanceThe MCP server provides tools for entity extraction, query refinement, and relevance checking to enhance RAG applications by integrating with OpenAI and Gemini.-
- AlicenseBqualityAmaintenanceA production-grade MCP server for integrating RAG into AI agents, supporting multiple vector databases with enterprise security and dynamic tool selection.215MIT
- AlicenseAqualityCmaintenanceAn MCP server that exposes RAG retrieval evaluation as agent tools, allowing agents to retrieve passages and measure retrieval quality across multiple strategies.3MIT