Which integrations are available for this server?

Provides tools for querying a local SQLite database, enabling retrieval of structured data via the local_db_query tool.

How do I use local-rag-mcp?

1. Click on "Deploy Server". 2. Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state. 3. In the chat, type @ followed by the MCP server name and your instructions, e.g., "@local-rag-mcp What does our documentation say about authentication?" That's it! The server will respond to your query, and you can continue using it as needed. Here is a step-by-step guide with screenshots.

local-rag-mcp

by Orax0001

Overview Schema Source Related Servers Discussions Admin

Python

Local

🔒 Privacy-Preserving Local RAG with MCP Integration

A production-grade, fully local Retrieval-Augmented Generation (RAG) system integrated with the Model Context Protocol (MCP). Zero data ever leaves your machine.

Architecture

User CLI  →  Agent Orchestrator  →  MCP Client (stdio)
                                          ↓
                               ┌──────────────────────┐
                               │     MCP Server        │
                               │  ┌────────────────┐  │
                               │  │  vector_search  │  │
                               │  │  local_db_query │  │
                               │  └────────────────┘  │
                               └──────────────────────┘
                                    ↓           ↓
                               Qdrant DB    SQLite DB
                               (Docker)   (employees)

Related MCP server: OpenRAG MCP Server

Tech Stack

Component	Technology
LLM Inference	Ollama (Llama 3)
Embeddings	Ollama (nomic-embed-text, 768d)
Vector Store	Qdrant (Docker)
Re-ranking	Cross-Encoder (ms-marco-MiniLM-L-6-v2)
MCP Server	FastMCP (Python SDK v1.x)
Chunking	SemanticChunker (LangChain Experimental)
Config	Pydantic Settings
Logging	structlog (JSON structured)

Prerequisites

Python 3.11+
Docker & Docker Compose
Ollama installed and running
At least 8GB RAM (16GB recommended)

Quick Start

1. Clone & Configure

git clone <repo-url>
cd local-rag-mcp
cp .env.example .env

2. Start Qdrant

docker compose up -d
# Verify: open http://localhost:6333/dashboard

3. Pull Ollama Models

# On Linux/macOS:
bash scripts/pull_models.sh

# On Windows (PowerShell):
ollama pull llama3
ollama pull nomic-embed-text

4. Create Python Environment

python -m venv .venv

# Linux/macOS:
source .venv/bin/activate

# Windows:
.venv\Scripts\activate

pip install -r requirements.txt

5. Seed the SQLite Database

python scripts/seed_database.py

6. Ingest Documents

python main.py
# Inside the REPL:
> /ingest data/documents

7. Run the Agent

python main.py
> What does our documentation say about authentication?
> List all employees in the Engineering department
> How many engineers earn above the department average?

Project Structure

local-rag-mcp/
├── docker-compose.yml       # Qdrant container
├── .env.example             # Config template
├── requirements.txt         # Pinned deps
├── pyproject.toml           # Project metadata & tool config
│
├── config/
│   └── settings.py          # Centralized Pydantic config
│
├── data/
│   ├── documents/           # Drop PDFs/Markdown here
│   └── sqlite/
│       └── employees.db     # Auto-seeded SQLite DB
│
├── scripts/
│   ├── seed_database.py     # Seeds employee DB
│   └── pull_models.sh       # Ollama model helper
│
├── src/
│   ├── ingestion/           # PDF/MD loader, semantic chunker, embedder
│   ├── mcp_server/          # FastMCP server + vector_search + local_db_query tools
│   ├── agent/               # Agent loop + HyDE
│   └── utils/               # Structured logging
│
├── tests/                   # Pytest test suite
└── main.py                  # CLI REPL entry point

CLI Commands

Command	Description
`/ingest <path>`	Ingest all PDFs/Markdown from directory
`/hyde on\|off`	Toggle HyDE query enhancement
`/help`	Show available commands
`/quit`	Exit the application
Any other text	Ask the agent a question

Configuration

All settings are controlled via .env. Key variables:

Variable	Default	Description
`OLLAMA_LLM_MODEL`	`llama3`	LLM for generation & tool calling
`OLLAMA_EMBEDDING_MODEL`	`nomic-embed-text`	Embedding model
`QDRANT_COLLECTION_NAME`	`rag_documents`	Qdrant collection name
`HYDE_ENABLED`	`true`	Enable HyDE query enhancement
`RERANKER_TOP_K`	`5`	Number of final results after re-ranking

Running Tests

pytest tests/ -v

License

MIT

This server cannot be deployed

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Maintenance

ActivitySlowing

ResponsivenessNo issues

Resources

GitHub Repository

Need Help?

Related Servers

Related MCP Connectors

llm-orchestration-agent-2
ai.getvda
MCP-Native LLM Orchestration Agent
Agent Orchestration AI & Machine Learning
1
llm-orchestration-mcp-agent
ai.getvda
LLM Orchestration MCP Agent
Autonomous Agents Agent Orchestration AI & Machine Learning
1
CustomGPT.ai
ai.customgpt.mcp
The CustomGPT.ai MCP server is a fully managed, RAG-powered endpoint that connects large language models with private knowledge bases and external data sources. It provides tools for retrieval-augmented generation queries (send_message), data ingestion (upload_file), and source listing, enabling AI agents to query private documents like PDFs with high accuracy and real-time citations.
RAG Systems Knowledge & Memory Search
2
polymnemo AOAuth
io.github.PCBZ
Shared cross-LLM long-term memory over MCP: semantic recall, sessions, and media (pgvector).
Knowledge & Memory Vector Databases RAG Systems
121

Related MCP Servers

spec-assistant
RAG Systems Code Analysis
beastkp
F
license
Not graded
quality
D
maintenance
Enables natural language queries on technical specifications and automated code compliance checks using local RAG with vector search, integrated via MCP.
Updated 3 months ago (2026-06-13 10:58 UTC)
-
OpenRAG MCP Server
RAG Systems Knowledge & Memory
janik96v
A
license
Not graded
quality
D
maintenance
An open-source MCP server for RAG over personal documents. Supports three parallel strategies — Traditional, Contextual, and Graph RAG — with all data stored locally for privacy.
Updated 6 months ago (2026-03-29 19:12 UTC)
MIT
Personal Knowledge Base Q&A
RAG Systems Knowledge & Memory Search
flashcoder07
F
license
Not graded
quality
C
maintenance
A local-first RAG system that indexes personal documents and enables querying them via an MCP tool, keeping data private with local embeddings.
Updated 2 months ago (2026-07-04 13:25 UTC)
-
vectordb-mcp
AliHaider20
F
license
Not graded
quality
C
maintenance
Local RAG system that ingests documents into a vector database using FAISS and SQLite, then enables Claude to search over them via MCP tools, all running locally with no API key required.
Updated 2 months ago (2026-07-21 01:16 UTC)
-