"Understanding Web Scraping Techniques" matching MCP servers:

• Documentation Retrieval & Web

  AIwithhassan

  F

  license

  A

  quality

  C

  maintenance

  Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.

  Last updated 2025-10-06

  1

  1

• FastMCP Documentation & Web

  jcdumlao14

  F

  license

  B

  quality

  C

  maintenance

  Enables web page scraping via Jina reader API and searching FastMCP documentation using minsearch. Supports fetching markdown content from URLs and querying indexed documentation files.

  Last updated 2025-12-21

  3
• 

  thunderbit-web-scraping-mcpofficial

  thunderbit-com

  A

  license

  -

  quality

  C

  maintenance

  Thunderbit MCP lets AI agents search, scrape, and extract structured data from any website.

  Last updated 2026-05-28

  12

  MIT

• Web Reader

  zacfire

  A

  license

  A

  quality

  D

  maintenance

  Enables Claude and other LLMs to read and parse web content, with smart fallback strategies to bypass access restrictions (e.g., paywalls, Cloudflare) and output Markdown.

  Last updated 2025-07-25

  5

  86

  39

  MIT

• Web Search MCP

  guhcostan

  A

  license

  B

  quality

  C

  maintenance

  Enables web searching via DuckDuckGo and extracting readable content from any URL using Mozilla Readability, providing web context similar to Cursor's built-in functionality.

  Last updated 2026-03-07

  2

  48

  3

  MIT

• MCP Web Scrape

  mukul975

  A

  license

  B

  quality

  C

  maintenance

  A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.

  Last updated 2026-02-16

  48

  18

  13

  MIT

• Web-curl MCP Server

  rayss868

  A

  license

  C

  quality

  C

  maintenance

  A powerful tool for fetching and extracting text content from web pages and APIs, supporting web scraping, REST API requests, and Google Custom Search integration.

  Last updated 2026-02-19

  5

  10

  MIT

• legacy-web-mcp

  hieutrtr

  A

  license

  -

  quality

  C

  maintenance

  Automatically crawl and analyze legacy web applications to generate documentation and modernization plans.

  Last updated 2025-09-22

  MIT

• mcp-whatsapp-web

  mario-andreschak

  A

  license

  -

  quality

  C

  maintenance

  Whatsapp-Web MCP

  Last updated 2025-04-29

  15

  MIT

• web-scrapper-stdio

  JustAzul

  A

  license

  -

  quality

  B

  maintenance

  A headless web scraping server that extracts main content from web pages into Markdown, text, or HTML for AI and automation integration. It features per-domain rate limiting and robust error handling using Playwright and BeautifulSoup.

  Last updated 2026-04-12

  MIT

• web-fetch-mcp

  xiaozhuABCD1234

  A

  license

  -

  quality

  C

  maintenance

  An MCP server that provides web scraping and Bing search capabilities, supporting both static and dynamic content through Puppeteer. It allows AI assistants to extract page summaries, SEO metadata, and full text with automatic detection for headless browser rendering.

  Last updated 2026-03-29

  GPL 3.0

• mcp-web

  TsFreddie

  A

  license

  -

  quality

  F

  maintenance

  Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.

  Last updated 2025-11-01

  7

  MIT

• Web Search MCP Server

  vishalkg

  F

  license

  -

  quality

  C

  maintenance

  Enables web search across multiple search engines (DuckDuckGo, Bing, Startpage) with parallel execution and result deduplication. Also provides web page content extraction capabilities.

  Last updated 2026-05-17

  2

• MCP Web Scraper

  navin4078

  F

  license

  -

  quality

  C

  maintenance

  A lightweight web scraping server that allows Claude Desktop users to extract various types of data from websites, including text, links, images, tables, headlines, and metadata using CSS selectors.

  Last updated 2025-06-10

  4

• Web-Scout

  UpperMoon0

  F

  license

  -

  quality

  D

  maintenance

  Enables AI-powered web searches using DuckDuckGo with automatic summarization via Google's Gemini AI. Supports both summary and detailed analysis modes for search results.

  Last updated 2026-05-21

• Web Researcher MCP

  zoharbabin

  A

  license

  A

  quality

  B

  maintenance

  MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.

  Last updated 2026-05-29

  30

  9

  13

  MIT

• perplexity-web-mcp

  quequiere

  A

  license

  A

  quality

  C

  maintenance

  An MCP server that enables AI assistants to perform web searches on Perplexity.ai using browser automation instead of an official API. It supports persistent authenticated sessions and returns search results along with cited sources directly to the client.

  Last updated 2026-03-06

  3

  25

  4

  MIT

• Web Resurrect MCP Server

  web-resurrect

  A

  license

  -

  quality

  C

  maintenance

  Enables AI assistants to resurrect expired domains by fetching archived URLs, scraping content from the Wayback Machine, and rewriting pages using AI. It provides comprehensive tools for SEO enrichment, AI image generation, and automated publishing to WordPress sites.

  Last updated 2026-05-04

  33

  44

  MIT

• MCP Web Search Tool

  gabrimatic

  A

  license

  A

  quality

  C

  maintenance

  A Model Context Protocol server that provides real-time web search capabilities to AI assistants through pluggable search providers, currently integrated with the Brave Search API.

  Last updated 2026-05-23

  1

  14

  MIT

• web-search-plus-mcp

  robbyczgw-cla

  A

  license

  A

  quality

  B

  maintenance

  A Model Context Protocol server that gives AI assistants access to 7 search providers with intelligent auto-routing. Analyzes query intent and picks the best provider automatically — no manual switching needed. Install, configure your keys, and go.

  Last updated 2026-05-29

  2

  MIT