"How to scrape web content" matching MCP servers:

A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.

Scrapes dynamic web pages via headless Chrome, stripping clutter and ads, and returns clean Markdown or JSON content. It integrates with Cloudflare Workflows and monetizes each extraction through the x402 protocol.

EU-native web scraping for AI agents & developers. scrape web pages into markdown, screenshots, metadata, and links, map sites, run asynchronous scrape jobs, and check usage, with EU-hosted, GDPR-aligned processing.

A Model Context Protocol server that provides real-time web search capabilities to AI assistants through pluggable search providers, currently integrated with the Brave Search API.

A fast, dependency-light MCP server that converts web pages into clean Markdown, structured metadata, and classified links for language models.

Screen-reader navigation cost analyzer. Measures how hard it is for assistive-technology users to discover, reach, and operate interactive targets on the web.

AutomateLab Content Distribution publishes content across DEV.to, Hashnode, GitHub Discussions, Reddit and Bluesky, with browser workflows for LinkedIn, Medium and X. Tracks publishing state and adapts content per platform. Product and documentation: https://automatelab.tech/products/mcp/content-distribution-mcp/

Enables web searches through DuckDuckGo without an API key and extracts readable main content from web pages.

Enables AI assistants to scrape pages, batch-process URLs, and crawl entire websites with AI-powered extraction.

An MCP server for web search, web fetching, and Context7 documentation tools with proxy support, designed for internal network environments.

Enables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.

Enables agents to search the live web and fetch URLs as clean Markdown, returning ranked search results and paginated page content through two lightweight tools.

MCP server providing browser compatibility data for the entire Web Platform.

Wraps Xiaomi MiMo's web_search API into an MCP tool for Claude Code, enabling real-time web searches with location awareness, automatic retry, and timeout control.

Provides local LLMs with web search and page fetching capabilities via MCP, with a focus on OWASP security best practices.

Enables AI clients like Claude to read and manage Microsoft To Do task lists and tasks via the Microsoft Graph API, running locally over stdio with secure token storage.

Connects AI assistants to authentic Islamic content including Qur'an, Hadith, and resources in multiple languages via over 80 tools.

TypeScript implementation of an MCP server that provides tools for web crawling, content extraction, and browser automation, enabling AI systems to access and process web content through 15 specialized tools.

Provides tools to scrape, crawl, and map web pages via the Basecrawl SaaS API.

Enables LLMs to run web searches through a single tool that fuses five providers in a tiered cascade, falling back from free sources to paid ones only when needed and returning the full routing chain. Ships with a one-click installer that detects and wirelessly configures ten AI agent CLIs.