Skip to main content
Glama
125,092 servers. Updated
Browse by product
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A server for crawling web pages and finding subpages" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • F
    license
    Not graded
    quality
    D
    maintenance
    An MCP server for safe web crawling and scraping of public and authenticated sites using Playwright and Crawlee. It provides tools for scraping single pages, crawling entire sites, validating sessions, and listing supported sites, with built-in security protections and adapter-based extensibility.
    -
  • F
    license
    A
    quality
    C
    maintenance
    Enables a locally-run LLM to search the web, fetch pages as markdown, make arbitrary HTTP requests, and optionally render pages with headless Chromium.
    3
    -
  • A
    license
    A
    quality
    B
    maintenance
    Gives AI agents local web search and page reading with no API keys, layering a SearXNG-backed search cache with browser-based fallbacks and returning clean page text from HTML, PDF, JSON, and archived snapshots. Fetches run in Docker alongside the search engine with SSRF protection, egress filtering, and untrusted-content marking so agents can safely retrieve live web data.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A fast web reader for AI assistants, served over MCP. It reads web pages and PDFs and returns only the passages that answer the question, not whole pages. It runs locally and keeps nothing.
    3
    7
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    A fault-tolerant, stealth-enabled Model Context Protocol (MCP) server for web searching and content fetching. Built for AI Agents (Cursor, Claude Code, OpenCode), it uses a stealth browser engine to fetch pages, dynamically handles SPAs/React, and converts bloat into token-optimized Markdown.
    2
    14 npm
    4
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables agents to perform local metasearch, scholarly and code/model lookups, and fetch rendered web pages or PDFs as paginated markdown, including stealth browsing and arXiv paper overviews.
    11
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A local MCP server providing web search, page extraction, and safe browser automation tools for Hermes, Claude Code, and other MCP clients.
    10
    MIT
  • F
    license
    B
    quality
    C
    maintenance
    Provides web search and page fetch tools for LLM assistants, extracting content and enabling text search within fetched pages.
    3
    -
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables web research through multi-provider search, documentation lookup, public code search, and clean Markdown extraction from static or JavaScript-rendered pages via five read-only tools.
    1
    Apache 2.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    MCP server for multi-engine web search and web page fetching, supporting parallel search, content extraction, and optional LLM-powered search summarization and deep search.
    6
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Provides eight tools for web search, content extraction, screenshots, PDFs, JavaScript execution, crawling, and Wayback Machine snapshots and archiving.
    1
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables compatible MCP clients to read JavaScript-rendered web pages as bounded Markdown or structured records, with URL policy and resource limits for safe, inspectable access.
    9 npm
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI assistants to automate web interactions such as navigating pages, clicking elements, filling forms, querying the DOM, evaluating JavaScript, and inspecting network/console logs — all from a Termux terminal without Chromium, root, or proot.
    1
    MIT
  • A
    license
    Not graded
    quality
    F
    maintenance
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides MCP tools to search and read social discussions from Reddit and X, and fetch pages blocked by bot protection, using a private Cloudflare Worker.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A self-hosted MCP server that reads web pages and converts them to Markdown, with built-in web search and anti-crawl fallback using Playwright.
    1
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Converts web pages to Markdown for MCP clients like Claude, with support for single and batch reads, caching, fallback rendering, and SSRF protection.
    35 npm
    MIT
  • F
    license
    Not graded
    quality
    B
    maintenance
    Enables fetching, crawling, and browsing anti-bot protected web pages with real browser rendering, returning clean JSON or markdown, and solving captchas.
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    Provides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.
    -
  • F
    license
    A
    quality
    C
    maintenance
    A local MCP server that gives Claude Code web search capabilities using DuckDuckGo, enabling discovery of URLs from natural language queries.
    1
    1
    -
  • A
    license
    A
    quality
    C
    maintenance
    MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    A web-fetch MCP server for LLM agents that fetches pages with an escalation ladder through different engines, raising FetchBlocked instead of returning blocked content.
    2
    3
    Apache 2.0
  • A
    license
    A
    quality
    D
    maintenance
    Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.
    1
    21 PyPI
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    An open-source MCP server providing AI agents with neural web search via Exa and tiered web fetch (Exa, local browser, Firecrawl) as a drop-in replacement for built-in web tools, preserving provenance and guarding against SSRF.
    6
    9
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables JavaScript-rendered Google searches and readable text extraction from public URLs via a real Chrome instance, along with health and CAPTCHA status monitoring.
    3
    69
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI assistants to fetch public web pages as readable text or HTML, with caching, live refresh, and parallel job handling.
    3
    17 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables lightweight web search discovery and on-demand extraction of cleaned page text from supplied URLs, returning snippets, headings, links, and saved full text for longer pages.
    2
    BSD 3-Clause
  • A
    license
    A
    quality
    B
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides LLMs with real-time web search and content extraction capabilities, including text/news search, full-text URL reading, and targeted technical documentation search.
    3
    25
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables reading web pages and PDFs as clean Markdown, extracting main content and letting agents query for relevant passages, outline sections, search in-page, and list links while respecting robots.txt and blocking private addresses.
    4
    1
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.
    25
    79
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to read pages as clean Markdown, map and crawl sites, run repeatable on-page SEO audits with prioritized fixes, extract structured data such as JSON-LD and tables, and compare a page against a competitor. Requests are guarded by SSRF protection, timeouts, size limits and robots.txt-honouring crawling.
    6
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    A DOM-first, vision-second MCP server for webpage analysis, combining structural DOM extraction with MiniMax vision to provide accurate, context-rich page understanding for AI coding assistants.
    4
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to search the web through DuckDuckGo, Google News, and Wikipedia, and to fetch readable text or pretty-printed JSON from web pages without API keys, accounts, or configuration.
    2
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables web searching and fetching pages converted to Markdown through local stdio MCP tools, so Claude Code and other MCP clients connected via third-party relays retain internet access instead of failing with a server-side tool protocol error. Includes paginated reading of long articles, SSRF/private-network blocking, and charset handling for legacy Chinese sites.
    4
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Enables live-web research by providing stateless browsing, link extraction, and page search capabilities via Playwright, allowing agents to fetch and analyze web content without session management.
    3
    -
  • F
    license
    A
    quality
    B
    maintenance
    Odysseus Web MCP is a standalone Model Context Protocol (MCP) server for safe public-web search and URL fetching.
    2
    -
  • A
    license
    A
    quality
    C
    maintenance
    Gives any AI agent two web capabilities: ranked search results with titles, URLs, dates and excerpts via Exa, and clean Markdown extraction of a page's main content with navigation, scripts and footers stripped. Responses are structured and schema-declared, and URL fetching is hardened against private addresses, redirects and DNS rebinding, so agents can research and cite sources safely across MCP clients.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Exposes Ollama's web search API as a web_search tool for Claude Code, enabling web searches (including sites other backends miss) with query and optional count parameters.
    1
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    A portable MCP server that scrapes SPA/JS-rendered webpages and extracts structured API endpoint data. It uses headless Chromium to render JavaScript and provides tools for scraping, endpoint extraction, screenshots, and database seeding.
    4
    1
    -
  • A
    license
    A
    quality
    C
    maintenance
    An MCP server that lets agents run free, keyless lead-leak audits on UK local service businesses — detecting form platforms and their outreach implications, checking whether phone numbers are tappable tel: links, comparing phone numbers across a site and free directories, screening website hygiene, and locating a business's own site. It also bundles these into a single full audit that returns a prioritised list of fixable issues alongside top local competitors.
    6
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that enables Claude Code to perform web searches via Bing, read webpage content, and get current time, with a smart search skill for structured multi-source verification.
    3
    2
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Provides web access capabilities for LLMs including search, fetching, content extraction, PDF reading, image viewing, and screenshots.
    3
    33 PyPI
    46
    MIT