mcp-poc
Embeds queries using a local Ollama model to retrieve relevant document chunks from a vector store for RAG search.
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
mcp-poc
A small Model Context Protocol (MCP) server that exposes the retrieval step of the sibling rag-poc project as an MCP tool — "RAG over MCP."
MCP is a standard way to give an LLM client (Claude Code, Claude Desktop, …) access to tools that live outside the model. Here the pattern is deliberate: the server does retrieval only — it embeds your query, finds the most similar chunks in rag-poc's local vector store, and hands them back. The client's model does the generation, reading those chunks and writing a grounded, cited answer. The server never calls a chat model.
The tool
Tool | Signature | What it does |
|
| Embeds |
The model calling it is expected to answer from the returned chunks and cite each
source, or say it doesn't know if they don't contain the answer.
Related MCP server: mcpscope
How it connects to rag-poc
This repo doesn't reimplement RAG — it imports rag-poc's rag package. The server
puts the rag-poc folder on sys.path and reuses its vector store, query embedder,
and input-sanitising hook. By default it expects rag-poc as a sibling folder
(../rag-poc); point elsewhere with the RAG_POC_PATH environment variable. The
store is read from RAG_POC_PATH/store.npz.
Prerequisites
Ollama running at
localhost:11434with thenomic-embed-textmodel pulled (ollama pull nomic-embed-text). The query must be embedded by the same model that embedded the documents.rag-poc ingested so its store exists — in the rag-poc folder:
python main.py ingest.
Setup
cd "C:\Coding Space\mcp-poc"
python -m venv .venv
.\.venv\Scripts\Activate.ps1
pip install -r requirements.txtTest it — two ways
1. MCP Inspector (no Claude needed):
mcp dev server.pyOpen the printed URL, pick rag_search, enter a query (e.g. "What is retrieval-augmented generation?"),
and inspect the returned chunks with their similarity scores.
2. From Claude Code. Register the server so rag_search appears in your session:
claude mcp add mcp-poc -- "C:\Coding Space\mcp-poc\.venv\Scripts\python.exe" "C:\Coding Space\mcp-poc\server.py"If rag-poc is not a sibling of this repo, pass its location when registering:
claude mcp add mcp-poc --env RAG_POC_PATH="C:\path\to\rag-poc" -- "C:\Coding Space\mcp-poc\.venv\Scripts\python.exe" "C:\Coding Space\mcp-poc\server.py"Then /mcp lists connected servers, and you can ask a question about your indexed
docs — Claude will call rag_search, pull the relevant chunks, and answer from them.
Remove it with claude mcp remove mcp-poc.
Next steps
Add a
rag_answertool that runs rag-poc's full local pipeline (Ollama generation) to compare "the client model generates" vs "the local model generates."Expose the indexed documents as MCP resources, or add a prompt template for a standard "answer with citations" instruction.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
MCP server for progressive tool usage at any scale (see https://klavis.ai)
Nifty's MCP server — exposes tasks, projects, messages, and files as tools for AI agents.
Related MCP Servers
- FlicenseBqualityNot gradedmaintenanceA minimal Model Context Protocol server that provides a simple tool for adding two integers. It serves as a demonstration of the official Python MCP SDK and is designed for local execution via stdio.1-
- FlicenseAqualityDmaintenanceA simple local MCP server that provides greeting and integer addition tools.2-
- FlicenseNot gradedqualityDmaintenanceA minimal MCP server demo in Python that exposes five tools for arithmetic and a simulated long-running process.-
- FlicenseNot gradedqualityDmaintenanceA minimal MCP server that exposes tools for addition, echoing text, time lookup, and URL fetching, with support for HTTP and stdio transports.-