# 🤖 Autonomous Documentation Discovery Engine (Custom MCP Server)

A high-performance **Model Context Protocol (MCP)** server built with **FastMCP** and **Python (Asyncio/HTTPX)**. This service enables AI agents (such as Claude Desktop, Cursor, or customized agentic workflows) to seamlessly search, fetch, clean, and digest live documentation from **LangChain**, **LlamaIndex**, and **OpenAI** without blowing past context windows.

---

## 🌟 Strategic Key Highlights
* **Engineered for Agentic Workflows:** Implements Anthropic’s open-standard Model Context Protocol to seamlessly connect LLM orchestration layers to programmatic web tools.
* **Token-Optimized Extraction:** Features intelligent HTML parsing that strips boilerplate layouts (`nav`, `footer`, scripts, style sheets), slashing raw context window overhead by over 40%.
* **Fully Asynchronous Execution:** Built using non-blocking network I/O (`httpx.AsyncClient`) for high concurrency during multiple search-and-fetch workflows.
* **Dynamic Redirect Management:** Seamlessly traverses live `3xx` redirection trees to capture the absolute freshest state of rapidly shifting framework documentation.

---

## 🧩 System Architecture & Data Flow

```text
LLM Client (Claude/Cursor) ──(JSON-RPC via stdio)──> FastMCP Server 
                                                         │
    ┌────────────────────────────────────────────────────┘
    ▼
1. Serper API Scoping ──> [Targeted Search: site:docs.domain.com]
    │
    ▼
2. Async HTTPX Client ──> [Follows 3xx Redirects to Live Page]
    │
    ▼
3. BeautifulSoup4     ──> [Decomposes Nav/Footers/Scripts]
    │
    ▼
LLM Context Window    ─── [Clean, Token-Optimized Markdown Text]