A
licenseNot graded
qualityA
maintenanceFetches webpages—and optionally crawls linked pages up to a configurable depth—then strips noise and converts the content into clean, token-efficient Markdown with links preserved. It caches results, respects robots.txt, and streams content for low memory use, making it suited for feeding AI agents, IDEs, and LLM pipelines readable web content.
MIT