Website to Markdown — Bounded Crawls for Agents
Server Details
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
The last two health checks of this connector failed. If this server requires authentication, missing or expired test credentials may be the cause. A test profile lets Glama authenticate for health checks and discover tools; it is separate from your personal connections.
If you are the author, claim ownership, then add or update a test profile under Admin → Test Profile.
- Status
- Unhealthy
- OAuth
- Works in Glama
- Last Tested
- Transport
- Streamable HTTP
- URL
Related MCP Connectors
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
Crawl and scrape websites to clean markdown, and track what changed between crawls.
PDFs, JavaScript pages and ordinary HTML as clean Markdown. Follows robots.txt per RFC 9309.
Web scraping to clean Markdown with JS rendering, multi-page crawl, structured extract, sitemaps.
Related MCP Servers
- AlicenseAqualityAmaintenanceAI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.6152MIT
- AlicenseNot gradedqualityAmaintenanceFetches webpages and crawls sites locally, stripping noise and converting content into clean, link-preserving Markdown with a minimal token footprint. Supports configurable crawl depth, concurrency, robots.txt compliance, and caching for efficient AI agent and LLM pipelines.MIT

MeshArcofficial
AlicenseNot gradedqualityAmaintenanceCrawl and scrape websites to clean markdown, map their sitemaps, and track what changed between crawls. Use the hosted server or run it locally.65 PyPIMIT- FlicenseNot gradedqualityAmaintenanceEnables AI agents and LLM pipelines to fetch webpages or crawl sites locally and convert the content into clean, token-efficient Markdown with links preserved. Includes caching, robots.txt-aware rate limiting, concurrent depth crawling, and optional chunking for downstream processing.-
Glama MCP Gateway
Add one secure layer between your agents and this server.