rag-mcp
Generates local embeddings for semantic search using Ollama's nomic-embed-text model, ensuring data privacy.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@rag-mcpWhat does my architecture doc say about the database layer?"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
rag-mcp
A personal knowledge base MCP server for Claude Desktop.
Drop in files (PDF, Markdown, plain text, code), and ask Claude questions that span your entire document collection. Powered by local embeddings via Ollama and ChromaDB for persistent vector storage.
Features
Index any document — PDF,
.md,.txt,.py,.js,.ts,.json,.yamlSemantic search — finds relevant content by meaning, not just keywords
Local & private — all embeddings generated locally via Ollama (no data leaves your machine)
Persistent — ChromaDB persists to disk; re-index only when documents change
Re-index safe — indexing the same file twice replaces old chunks cleanly
Related MCP server: punt-quarry
Tools exposed to Claude
Tool | Description |
| Index a file into the knowledge base |
| Semantic search across all indexed documents |
| List every document currently in the index |
| Remove a document and all its chunks |
Resource: doc://{filename} — read all raw chunks for a specific document
Requirements
Setup
git clone https://github.com/Kamalesh-Kavin/rag-mcp
cd rag-mcp
cp .env.example .env
uv syncClaude Desktop configuration
Add this to ~/Library/Application Support/Claude/claude_desktop_config.json:
{
"mcpServers": {
"rag-assistant": {
"command": "/path/to/uv",
"args": [
"--directory",
"/path/to/rag-mcp",
"run",
"rag-mcp"
]
}
}
}Usage in Claude
Index a document:
"Index the file /Users/me/notes/architecture.md"
Ask a question:
"What does my architecture doc say about the database layer?"
List what's indexed:
"What documents are in my knowledge base?"
Delete a document:
"Remove architecture.md from the knowledge base"Architecture
File on disk
│
▼
read_file() ← pypdf (PDF) or open() (text/code)
│
▼
chunk_pages() ← sliding window: 1000 chars, 200 overlap
│
▼
embed_chunks() ← POST http://localhost:11434/api/embeddings
│ nomic-embed-text → 768-dim vector
▼
VectorStore.add() ← ChromaDB PersistentClient, cosine similarity
│
▼
search_docs() ← embed query → cosine nearest-neighbour lookupProject structure
src/rag_mcp/
├── __init__.py
├── ollama_client.py # async httpx wrapper for Ollama embeddings API
├── ingestion.py # file readers, chunker, ingest pipeline
├── vector_store.py # ChromaDB wrapper (add, search, list, delete)
└── server.py # MCP server — 4 tools + 1 resource
data/documents/ # drop files here to index themLicense
MIT
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Latest Blog Posts
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/Kamalesh-Kavin/rag-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server