LiveKit RAG Assistant
Provides async LangChain integration for building RAG (Retrieval-Augmented Generation) pipelines with semantic search and LLM-powered responses
Offers a premium glassmorphism UI for interacting with the LiveKit documentation search system, featuring real-time chat, animations, and source attribution
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@LiveKit RAG AssistantHow do I set up audio rooms in LiveKit?"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
š¬ LiveKit RAG Assistant v2.0
Enterprise-grade AI semantic search + real-time web integration for LiveKit documentation
šÆ Features
Dual Search: Pinecone docs (3,000+ vectors) + Tavily real-time web
Standard MCP: Async LangChain with Model Context Protocol
Ultra-Fast: Groq LLM (llama-3.3-70b) sub-5s responses
Premium UI: Glassmorphism design with 60+ animations
Source Attribution: Full transparency on every answer
Related MCP server: Semantic Search MCP Server
š Quick Start
# Setup
conda create -n langmcp python=3.12
conda activate langmcp
pip install -r requirements.txt
# Configure .env
GROQ_API_KEY=your_key
TAVILY_API_KEY=your_key
PINECONE_API_KEY=your_key
PINECONE_INDEX_NAME=livekit-docs
# Terminal 1: Start MCP Server
python mcp_server_standard.py
# Terminal 2: Start UI
streamlit run app.pyApp opens at http://localhost:8501
šļø Architecture
Streamlit (app.py) ā MCP Server ā Dual Search:
āā Pinecone: Semantic search on embeddings (384-dim)
āā Tavily: Real-time web results
ā
Groq LLM (2048 tokens, temp 0.3) ā Response + Sourcesš§ Tech Stack
Layer | Tech | Purpose |
Frontend | Streamlit | Premium glassmorphism UI |
Backend | MCP Standard | Async subprocess |
LLM | Groq API | Ultra-fast inference |
Embeddings | HuggingFace | all-MiniLM-L6-v2 (384-dim) |
Vector DB | Pinecone | Serverless similarity search |
Web Search | Tavily | Real-time internet results |
š Usage
Choose mode: š Docs or ļæ½ Web
Ask naturally: "How do I set up LiveKit?"
Get instant answer with š sources
Copy messages or re-ask from history
ā” Performance
First query: ~15-20s (model load)
Cached queries: 2-5s
Search latency: <500ms
š ļø Configuration
GROQ_API_KEY=gsk_***
TAVILY_API_KEY=tvly_***
PINECONE_API_KEY=***
PINECONE_INDEX_NAME=livekit-docsš Populate Docs
python ingest_docs_quick.py # Creates 3,000+ vector chunksš Files
app.py- Streamlit UI with premium designmcp_server_standard.py- MCP server with toolsingest_docs_quick.py- Document ingestionrequirements.txt- Dependencies.env- API keys
šØ Troubleshooting
Issue | Solution |
No results | Try web mode or different keywords |
MCP not found | Start mcp_server_standard.py in Terminal 1 |
Slow first response | Normal (15-20s) - model initializes once |
API errors | Verify all keys in .env file |
ļæ½ Features
ā Real-time chat with 60+ animations ā Semantic + keyword hybrid search ā Copy-to-clipboard for messages ā Recent query suggestions ā System status dashboard ā Chat history persistence ā Query validation + error handling
Version: 2.0 | Status: ā Production Ready | Created: November 2025
šØāš» By @THENABILMAN | ļæ½ Open Source | ā¤ļø For Developers
This server cannot be deployed
Maintenance
Related MCP Connectors
Apple Developer Documentation with Semantic Search, RAG, and AI reranking for MCP clients
Ingest, manage, and retrieve documents for RAG-powered AI applications
Search your knowledge bases from any AI assistant using hybrid RAG.
Versioned documentation registry and semantic search for AI tools and coding assistants.
Related MCP Servers
- AlicenseNot gradedqualityFmaintenanceEnables AI assistants to enhance their responses with relevant documentation through a semantic vector search, offering tools for managing and processing documentation efficiently.9 npm64MIT
- FlicenseNot gradedqualityDmaintenanceEnables semantic search over documentation stored in a Vectorize database using the Cloudflare Agents SDK, allowing users to query indexed content via natural language.4-
- FlicenseNot gradedqualityDmaintenanceEnables AI-powered search and querying of the Vercel AI SDK documentation using natural language questions, with tools for direct similarity search and agent-based answers.50-
- FlicenseNot gradedqualityDmaintenanceEnables semantic search of Weaviate documentation using vector search, providing relevant documents and code snippets.-