Provides AI agents and assistants with advanced web crawling and RAG capabilities, enabling them to scrape websites and perform semantic search over crawled content.
Provides web crawling and RAG capabilities for AI agents, enabling scraping of websites, storing content in a vector database (Supabase), and performing semantic search over crawled data.
Enables AI agents to mirror websites into a shared archive in the background, then browse projects, list and read text files, and run substring searches over the downloaded content. Concurrency isolation per project allows multiple sites to be mirrored in parallel with status polling over MCP.