A
licenseA
qualityC
maintenanceThis server crawls documentation sites and provides search and page-retrieval tools through MCP, enabling users to query indexed documentation content.
4
MIT
73,463 servers. Updated
Search Relevance ↓
Recent Usage ↓
Date Added ↓
Date Updated ↓
Weekly Downloads ↓
GitHub Stars ↓
Recent GitHub Stars ↓
Matching MCP tools:
Matching MCP Connectors:
io.github.pipeworx-io
io.github.lazymac2x
io.github.eltociear
io.github.varvararatta
"Web crawler for sequential URL content retrieval" matching MCP servers:
- FlicenseAqualityDmaintenanceEnables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.12
- FlicenseAqualityBmaintenanceEnables AI agents to search private GitHub Pages by authenticating in a dedicated browser and retrieving indexed sections from a local SQLite database, with support for multiple sites and languages.101
- Alicense-qualityAmaintenanceContent Registry - MCP server providing AI-powered tools and automation by MEOK AI Labs9MIT
- Alicense-qualityDmaintenanceEnables comprehensive content management through Markdown processing, HTML rendering, intelligent fuzzy search, and document analysis. Supports frontmatter parsing, tag-based filtering, table of contents generation, and directory statistics for efficient content organization and discovery.143MIT
- Flicense-qualityBmaintenanceAn MCP server that retrieves and cleans official documentation for popular AI/Python libraries via web search and LLM processing, exposing a get_docs tool.
- FlicenseAqualityBmaintenanceA local-first MCP server for web search and documentation fetching, providing free DuckDuckGo search, URL-to-markdown conversion, and library docs from npm, PyPI, crates.io, Go, and GitHub with caching.5
- FlicenseAqualityBmaintenanceA version-aware cache for web research that stores and serves documentation references, preventing models from re-researching the same topics across sessions.7
- FlicenseBqualityDmaintenanceA BM25-based MCP server that enables document search and retrieval across structured domains of knowledge content, allowing Claude to search and reference documentation when answering questions.41
- AlicenseBqualityFmaintenanceAutomatically crawls documentation websites, converts them to organized markdown files, and generates condensed cheat sheets. Intelligently categorizes content into tools/APIs and provides local-first access to downloaded documentation.3GPL 3.0
- Alicense-qualityAmaintenanceA self-hosted MCP server that crawls, indexes, and searches documentation from any website locally, including private sites requiring authentication. It provides hybrid search capabilities and local embedding generation to maintain privacy while keeping AI assistant knowledge up to date.2,1941MIT
- Alicense-qualityDmaintenanceAutomatically crawl and analyze legacy web applications to generate documentation and modernization plans.MIT
- Flicense-qualityCmaintenanceThe public MCP server for togo — docs, the plugin marketplace, and plugin submission, for any agent.1
- Flicense-qualityCmaintenanceMCP server for searching web documentation via sitemap.xml, enabling semantic search across multiple documentation sites using Ollama embeddings.
- AlicenseAqualityCmaintenanceMCP server providing browser compatibility data for the entire Web Platform.7421MIT
- AlicenseAqualityDmaintenanceProvides AI coding assistants with on-demand access to component specs, test scenarios, accessibility requirements, and build guides from the Web UI Component Specification.10MIT
- AlicenseAqualityCmaintenanceProvides AI assistants with specialized tools to interact with NIST's Open Security Controls Assessment Language (OSCAL) framework. It enables agents to retrieve schemas, explore models, and generate valid OSCAL documentation for security compliance automation.4051Apache 2.0
- AlicenseBqualityCmaintenanceParse any file or URL into structured text. Extract text from PDF, DOCX, YouTube, web pages, images, and 25+ formats via one API. Tools: parse_url, parse_file, get_youtube_transcript.313MIT
- Alicense-qualityDmaintenanceDelivers curated documentation, quickstart commands, and stack recommendations for modern full stack web development through MCP-enabled AI assistants.MIT
- Alicense-qualityDmaintenanceToolset that crawls websites, generates Markdown documentation, and makes that documentation searchable via a Model Context Protocol (MCP) server for integration with tools like Cursor.42MIT