🎬 YTPipe - AI-Native YouTube Processing Pipeline

Transform YouTube videos into LLM-ready knowledge bases with a production-ready MCP backend.

Quick Start • Features • Documentation • MCP Tools

✨ Features

• 🤖 MCP Integration - 12 AI-callable tools for seamless agent integration

• 🎯 Smart Chunking - Semantic text chunking with timeline timestamps

• 🧠 Vector Embeddings - 384-dimensional embeddings for semantic search

• 🔍 Full-Text Search - Context-aware transcript search

• 📊 SEO Intelligence - AI-powered title, tag, and description optimization

• ⏱️ Timeline Analysis - Topic evolution and keyword density tracking

• 🏗️ Microservices - 11 independent, composable services

• 🔐 Type-Safe - Pydantic models throughout

• ⚡ Async-First - Non-blocking I/O operations

• 🗄️ Multi-Backend - ChromaDB, FAISS, Qdrant support

🚀 Quick Start

Result: Metadata + Transcript + Semantic Chunks + Embeddings + Vector Storage

🎯 Usage Examples

MCP Server (AI Agents)

Then from Claude Code:

CLI (Humans)

Python API (Developers)

📋 MCP Tools

Pipeline (4 tools)

• ytpipe_process_video - Full pipeline

• ytpipe_download - Download only

• ytpipe_transcribe - Transcribe audio

• ytpipe_embed - Generate embeddings

Query (4 tools)

• ytpipe_search - Full-text search

• ytpipe_find_similar - Semantic search

• ytpipe_get_chunk - Get chunk by ID

• ytpipe_get_metadata - Get video info

Analytics (4 tools)

• ytpipe_seo_optimize - SEO recommendations

• ytpipe_quality_report - Quality metrics

• ytpipe_topic_timeline - Topic evolution

• ytpipe_benchmark - Performance analysis

🏗️ Architecture

Services:

• Extractors (2): Download, Transcriber

• Processors (4): Chunker, Embedder, VectorStore, Docling

• Intelligence (4): Search, SEO, Timeline, Analyzer

• Exporters (1): Dashboard

8 Processing Phases:

1. Download → 2. Transcription → 3. Chunking → 4. Embeddings →

2. Export → 6. Dashboard → 7. Docling → 8. Vector Storage

📊 Performance

🔧 Requirements

• Python 3.8+

• FFmpeg (for audio extraction)

• 4GB+ RAM recommended

• GPU optional (CUDA for acceleration)

📖 Documentation

• Quick Start

• Setup Guide

• Architecture

• API Reference

• Development Guide

🤝 Contributing

Contributions welcome! Please read CONTRIBUTING.md first.

📝 License

MIT License - see LICENSE for details.

🙏 Credits

Built with:

• FastMCP - MCP server framework

• OpenAI Whisper - Speech-to-text

• sentence-transformers - Text embeddings

• Model Context Protocol - AI tool standard

📧 Contact

Leonardo Lech

• Email: leonardo.lech@gmail.com

• GitHub: @leolech14

⭐ Star this repo if you find it useful!

Transform YouTube → Knowledge Base in seconds