mcp-agentic-rag
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@mcp-agentic-rag search my documents for information on text classification"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Agentic RAG MCP
A minimal FastAPI + FastMCP project that combines local RAG retrieval with Firecrawl web fallback.
What this project does
Loads a FastAPI application for document ingestion and vector queries.
Uses ChromaDB for local vector storage and SentenceTransformers for embeddings.
Provides an MCP tool server via
fastmcpto expose RAG tools over stdio transport.Falls back to Firecrawl web search only when the local vector DB returns no documents.
Related MCP server: RAG MCP Server
Repository structure
app/- application source codeapi/- FastAPI routes and schemascore/- RAG logic, embeddings, fallback helperservices/- ChromaDB service integrationmcp/- FastMCP server entrypoint
scripts/- utility scripts (seed data, etc.)data/- storage and persistence directories.env.example- environment variable templatepyproject.toml- project dependencies and packaging config
Setup for a new user
1. Clone the repository
git clone https://github.com/sampathpulukurthi/agentic-rag-mcp.git
cd agentic-rag-mcp2. Create a Python virtual environment
python3 -m venv .venv
source .venv/bin/activate3. Install dependencies
python -m pip install -e .4. Create environment variables
cp .env.example .envEdit .env and set:
FIRECRAWL_API_KEY=your_firecrawl_api_key_here5. Run the FastAPI backend
uvicorn app.main:app --host 127.0.0.1 --port 8000 --reloadThen verify:
curl http://127.0.0.1:8000/api/health6. Run the MCP server
With the virtualenv active:
.venv/bin/python -m app.mcp.serverThis starts the FastMCP server named mcp-agentic-rag using stdio transport.
How to use
Ingest documents
curl -X POST http://127.0.0.1:8000/api/ingest \
-H "Content-Type: application/json" \
-d '{"documents": [{"id":"doc1","text":"Machine learning models can classify text.","metadata":{"topic":"ml"}}]}'Query local vector store
curl -X POST http://127.0.0.1:8000/api/query \
-H "Content-Type: application/json" \
-d '{"query_text":"How do text classification models work?","k":3}'Query with fallback to Firecrawl
curl -X POST http://127.0.0.1:8000/api/query_with_fallback \
-H "Content-Type: application/json" \
-d '{"query_text":"What is machine learning?","k":5}'If the vector store returns no documents, the endpoint will return fallback: true and web_results from Firecrawl.
Notes
There is currently no chat UI included in this repository.
The app returns vector DB matches by default and only uses Firecrawl when local results are empty.
If you want stronger fallback behavior, the
query_with_fallbacklogic can be updated to use a similarity threshold.
Available Tools
3 toolsquery_ragD
Query the RAG knowledge base
Inputs: query (required), k. Returns: object
query_rag_with_fallbackC
Query the RAG knowledge base with web fallback
Inputs: query (required), k. Returns: object
seed_faqA
Seed the knowledge base with the ML FAQ dataset
Inputs: no named parameters. Returns: object
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 3 tools
The two query tools are distinguished by the fallback feature, and seed is clearly separate. Some confusion possible but descriptions help.
All tools follow a consistent snake_case verb_noun pattern, making naming predictable and logical.
With only 3 tools, the set feels minimal but is within acceptable bounds for a simple RAG server. However, missing management tools make it slightly thin.
The toolset lacks capabilities to update, delete, or list documents, which are essential for a complete RAG knowledge base management. This is a significant gap.
Maintenance
Related MCP Connectors
Scrape, crawl and search the web for AI agents via MCP.
OCR, transcription, file extraction, and image generation for AI agents via MCP.
Turn a GitHub repo or docs site into agent-ready context: pack it or search it, over MCP.
Scrape, crawl, and search the web via Firecrawl’s official hosted MCP.
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceProvides tools for ingesting documents into a local vector database and retrieving relevant information via semantic search, enabling retrieval-augmented generation for MCP clients.8-
- FlicenseNot gradedqualityDmaintenanceExposes a Retrieval-Augmented Generation pipeline as MCP tools, allowing users to index documents and query them through any MCP-compatible client like Claude or IDEs.-

dryad-rag-mcpofficial
AlicenseAqualityDmaintenanceExposes a RAG document-search API as MCP tools (rag_health, rag_ingest, rag_query), enabling agents to index and search markdown documents with cited results through natural language.3MIT- AlicenseAqualityDmaintenanceExposes hybrid retrieval (dense embeddings + BM25 + RRF) and document operations (search, fetch, rerank) as MCP tools, using Qdrant and OpenAI embeddings for local or server mode.3MIT