"How to scrape web content" matching MCP servers:

Enables MCP-compatible agents to scrape web pages and distill them into clean Markdown by removing cookie banners, navbars, and ads for efficient consumption.

MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.

Provides web access tools (fetch, search, sitemap crawl) through String AI's API, automatically handling anti-bot bypass, CAPTCHA, and JavaScript rendering.

EU-native web scraping for AI agents & developers. scrape web pages into markdown, screenshots, metadata, and links, map sites, run asynchronous scrape jobs, and check usage, with EU-hosted, GDPR-aligned processing.

Enables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.

Web tools for AI agents. Search the web for full page content, fetch URLs as clean markdown including PDFs, extract structured data from a page with a prompt, and run multi-source deep research that returns a cited report.

Screen-reader navigation cost analyzer. Measures how hard it is for assistive-technology users to discover, reach, and operate interactive targets on the web.

This server enables LLMs to retrieve and process content from web pages, converting HTML to markdown for easier consumption.

Enables AI assistants to scrape pages, batch-process URLs, and crawl entire websites with AI-powered extraction.

Enables AI agents to scrape, crawl, and map websites into LLM-ready markdown via the Metalift API

Enables AI agents in Claude Code, Claude Desktop, Cursor, VS Code, Windsurf, Gemini CLI and Codex to scrape web pages into Markdown, text, HTML, JSON or PDF, extract structured data with selectors or autoparse, capture screenshots and PDFs the model can see, drive pages with typed browser actions, keep logged-in persistent browser sessions, and batch-scrape thousands of URLs as async jobs. It also exposes usage, request-log and documentation tools so agents can check costs, diagnose failures and look up parameters without leaving the chat.

Provides tools to scrape, crawl, and map web pages via the Basecrawl SaaS API.

An MCP server that enables web search and page content retrieval via the Keenable API, supporting search with filters and fetching clean markdown content from indexed URLs.

Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation

Enables calling 120+ AI models and reading live web pages (scrape, crawl, structured extract) from any MCP client using one API key.

Enables AI agents to scrape, search, map, and crawl the web through residential proxies with real-browser TLS fingerprints, and to generate ready-to-use proxy endpoints of various types for any HTTP client.

One MCP server. All web data. Search, scrape, crawl, proxy, and AI research — in a single npx command.

A Model Context Protocol server that enables Claude Desktop to browse the web, likely allowing the AI to access and interact with web content.

Enables AI agents to scrape websites protected by Cloudflare, DataDome, and Akamai, bypassing anti-bot measures to retrieve page content.

Enables AI assistants to generate interactive mind maps from text, YouTube videos, and web content using Mapify's API.