"Crawling Websites to Extract Data" matching MCP servers:

MCP server for Averra Extract — lets AI agents like Claude, Cursor, and ChatGPT convert any webpage into clean, LLM-ready Markdown.

A paid MCP server that extracts structured product data (schema.org/Product) from any URL via headless browser, charging $0.01 USDC per call through x402 micropayments.

Enables extracting precise data from web pages by parsing the DOM with CSS selectors and returning structured JSON, while also offering tools to inspect page structure, discover candidate selectors, and verify them without loading full pages into context.

Extracts any Instagram post, reel, or multi-slide carousel and converts captions, OCR text, and metadata into structured screener filters such as PER, PBV, ROE, RSI, and volume for reusable IG-to-screener workflows.

Extracts brand identity (colors, typography, spacing) from any website and generates HTML/CSS replicas or applies branding to templates.

MCP server for structured web data access, enabling local-market research and lead-list enrichment by returning business names, locations, ratings, and review signals from concrete queries.

An MCP server for safe web crawling and scraping of public and authenticated sites using Playwright and Crawlee. It provides tools for scraping single pages, crawling entire sites, validating sessions, and listing supported sites, with built-in security protections and adapter-based extensibility.

MCP server providing web search, fetch, and crawl capabilities for AI agents via the spider.cloud API, with caching, cost controls, and robust error handling.

An MCP server that automates converting diverse content sources like WeChat articles, YouTube videos, and various document formats into AI-generated outputs such as podcasts and slide decks via Google NotebookLM. It integrates specialized tools for web scraping, OCR, and file transformation to facilitate seamless content generation through natural language.

Enables AI agents to retrieve X/Twitter profiles and tweets, YouTube video and channel data, and TikTok profile and video stats on a pay-per-result basis without requiring login or platform API keys.

Enables extraction of YouTube video information including metadata (title, description, channel, views) and transcripts without requiring an API key, using yt-info-extract and yt-ts-extract libraries.

Provides structured Airbnb search results, listing details, and calendar availability through an MCP server.

Enables AI agents to query structured data refined from unstructured web sources, including developer breaking changes, B2B pricing matrices, regulatory compliance, semantic search, and on-demand URL refinement.

Enables converting webpages into structured JSON using CSS-selector schemas, with anti-bot handling and support for protected pages.

Enables converting any webpage to clean LLM-ready markdown, with extraction, article, and news modes, using a real browser with anti-bot handling.

Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.

An MCP server that runs Apify scraping actors with quality-gated validation, scoring, and retries, returning embedding-ready chunks for AI agents.

Enables converting a public release-note URL into ordered upgrade tasks with source excerpts, anchors, confidence, and uncertainty, without executing release text or project code.

Real-time Korean web data for AI assistants — Naver Place reviews, Melon charts, Daangn/Bunjang marketplace, Naver News, Musinsa fashion rankings. 7 tools powered by Apify actors.

Enables to search, analyze, and export Douyin (TikTok China) video and user data, including interaction metrics, content length, and keyword trends.