"How to scrape a website" matching MCP servers:

基于百度图片搜索API，支持图片搜索、下载及格式转换的MCP服务器。

Enables AI agents to scrape, crawl, clean, chunk, and index website content into Azure AI Search for full-text retrieval.

Fetches and analyzes website content to provide business context to AI agents, designed for Voice AI in GoHighLevel.

A website audit MCP server that provides free tools to check on-page SEO elements like titles, descriptions, and images across up to 20 pages, and also validates robots.txt, sitemap.xml, and llms.txt accessibility.

Enables AI assistants to check how discoverable a website is to AI search engines and assistants by inspecting signals like crawler access, llms.txt, structured data, and on-page metadata, and returning a 0-100 visibility score.

Enables AI agents to fetch one or many web pages concurrently and receive clean, LLM-ready Markdown with navigation, ads and boilerplate stripped away, plus extracted metadata such as title, description, author, Open Graph tags and canonical URL. It runs locally over stdio with no API key or account, requiring only a single command.

Enables scraping of emails, phone numbers, and social profile links from website domains. Supports batch processing of up to 20 domains and can find company websites by keyword/company name.

Enables web scraping with JavaScript rendering, screenshots, and proxy support via the Scrapedo API, allowing Claude to scrape any website.

Provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.

Fetches website content and converts it to Markdown format with AI-powered content cleanup, ad removal, and full OpenAPI/Swagger specification support for easy processing by AI assistants.

Thunderbit MCP lets AI agents search, scrape, and extract structured data from any website.

Enables converting any URL or website into clean, LLM-ready Markdown, supporting single-page scraping and full-site crawling for AI agents.

MCP server that fetches and converts website pages into clean markdown for agents, with sitemap-based discovery, disk caching, and polite crawling (robots.txt, rate limiting).

Clone, scrape and crawl any website. Free Firecrawl alternative with no API keys or rate limits.

MCP server that lets AI agents scrape web pages as clean markdown for a micro-payment in USDC, using the x402 protocol on Base network. No API keys or signup required.

根据关键词获取小红书的热帖数据，需要钉钉扫码登录，配合 Chrome 使用。

An authless Cloudflare Workers server that provides tools to scrape, analyze, and answer questions about websites using Cloudflare's Browser Rendering and AI capabilities.

Provides LLMs with real-time weather forecasts for Israeli cities using browser automation with Playwright to scrape live data from a weather website.

A lightweight MCP server implementation that provides a simple tool for fetching website content, demonstrating how tools can be exposed and interacted with using the MCP protocol.

Enables converting webpages into structured JSON using CSS-selector schemas, with anti-bot handling and support for protected pages.