Scrape a public URL to create a searchable knowledge base. Extracts content from web pages (including JavaScript-rendered), chunks it, and indexes for RAG.
MIT
Hosted Web Crawler MCP server for Claude, ChatGPT and Cursor, with each action switched per account.
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.