rag-mcp
Generates local embeddings for semantic search using Ollama's nomic-embed-text model, ensuring data privacy.
Click on "Install Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@rag-mcpWhat does my architecture doc say about the database layer?"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
rag-mcp
A personal knowledge base MCP server for Claude Desktop.
Drop in files (PDF, Markdown, plain text, code), and ask Claude questions that span your entire document collection. Powered by local embeddings via Ollama and ChromaDB for persistent vector storage.
Features
Index any document — PDF,
.md,.txt,.py,.js,.ts,.json,.yamlSemantic search — finds relevant content by meaning, not just keywords
Local & private — all embeddings generated locally via Ollama (no data leaves your machine)
Persistent — ChromaDB persists to disk; re-index only when documents change
Re-index safe — indexing the same file twice replaces old chunks cleanly
Related MCP server: Local Knowledge RAG MCP Server
Tools exposed to Claude
Tool | Description |
| Index a file into the knowledge base |
| Semantic search across all indexed documents |
| List every document currently in the index |
| Remove a document and all its chunks |
Resource: doc://{filename} — read all raw chunks for a specific document
Requirements
Setup
git clone https://github.com/Kamalesh-Kavin/rag-mcp
cd rag-mcp
cp .env.example .env
uv syncClaude Desktop configuration
Add this to ~/Library/Application Support/Claude/claude_desktop_config.json:
{
"mcpServers": {
"rag-assistant": {
"command": "/path/to/uv",
"args": [
"--directory",
"/path/to/rag-mcp",
"run",
"rag-mcp"
]
}
}
}Usage in Claude
Index a document:
"Index the file /Users/me/notes/architecture.md"
Ask a question:
"What does my architecture doc say about the database layer?"
List what's indexed:
"What documents are in my knowledge base?"
Delete a document:
"Remove architecture.md from the knowledge base"Architecture
File on disk
│
▼
read_file() ← pypdf (PDF) or open() (text/code)
│
▼
chunk_pages() ← sliding window: 1000 chars, 200 overlap
│
▼
embed_chunks() ← POST http://localhost:11434/api/embeddings
│ nomic-embed-text → 768-dim vector
▼
VectorStore.add() ← ChromaDB PersistentClient, cosine similarity
│
▼
search_docs() ← embed query → cosine nearest-neighbour lookupProject structure
src/rag_mcp/
├── __init__.py
├── ollama_client.py # async httpx wrapper for Ollama embeddings API
├── ingestion.py # file readers, chunker, ingest pipeline
├── vector_store.py # ChromaDB wrapper (add, search, list, delete)
└── server.py # MCP server — 4 tools + 1 resource
data/documents/ # drop files here to index themLicense
MIT
Maintenance
Resources
Unclaimed servers have limited discoverability.
Looking for Admin?
If you are the server author, to access and configure the admin panel.
Related MCP Servers
- AlicenseAqualityAmaintenancePrivacy-first local document search using semantic search. Runs entirely on your machine with no cloud services, supporting PDF, DOCX, TXT, and Markdown files.93,100360MIT
- Alicense-qualityBmaintenanceSemantic search and retrieval system for local documents using vector embeddings, enabling AI-powered search across your document collections with support for multiple embedding providers.9MIT
- Alicense-qualityAmaintenanceLocal-first memory and retrieval for private project knowledge. Enables indexing files, searching, and asking questions about project documents using local embeddings and LLM.6AGPL 3.0
- Flicense-qualityCmaintenanceEnables semantic search over personal files using natural language, with optional AI summarization, all running locally.
Related MCP Connectors
Persistent memory and knowledge management for AI agents with semantic search and 50+ tools.
Shared knowledge base for AI agents. Semantic search across agents, no setup required — just a URL.
Long-term memory for AI assistants. Hybrid retrieval, query expansion, auto-topics.
Latest Blog Posts
- Who's Calling? MCP Hosts Are an Identity Blind Spot (And the Spec Knows It)By Om-Shree-0709 on .mcpAgent IdentityOAuth 2.1
- Your AI Chatbot Just Exposed Your CEO's Salary to an InternBy Om-Shree-0709 on .Agent IdentityMCP SecurityOAuth Delegation
- Why MCP Servers Need Execution Sandboxing (And Why Your Current Stack Isn't Enough)By Om-Shree-0709 on .Agentic AiPrompt InjectionWebAssembly
MCP directory API
We provide all the information about MCP servers via our MCP API.
curl -X GET 'https://glama.ai/api/mcp/v1/servers/Kamalesh-Kavin/rag-mcp'
If you have feedback or need assistance with the MCP directory API, please join our Discord server