Scrapes webpages and converts them to markdown using AI-powered interaction to automatically handle cookie banners, CAPTCHAs, paywalls, and other blocking elements before extracting clean content.
Provides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.
Crawl any website into clean Markdown, search through pages, read full content, and extract structured data using OpenAI, Claude, Gemini, or Grok — with auto-citation and resume support.
Enables conversion of webpages to clean markdown with content quality scoring and multi-page crawling for documentation sites. Supports Claude Code, Cursor, and Windsurf with native LangChain and LlamaIndex export formats.
Enables Claude to scrape and crawl websites via a self-hosted Firecrawl instance through the Model Context Protocol. Provides tools for single/multi-URL scraping, site mapping, and full-site crawling operations.
