Skip to main content
Glama
125,092 servers. Updated
Browse by product
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A server for crawling web pages and finding subpages" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    A
    quality
    C
    maintenance
    Enables reading and sending messages in Google Messages for web through a paired Chrome tab using chromefile, with tools for status, listing conversations, reading message history, and sending texts.
    4
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    MCP server for Facebook Pages organic analytics and management using Meta Graph API v25.0. Enables AI assistants to read page insights, posts, comments, and publish content via natural language.
    9
    50 npm
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    Enables deployment of HTML content, folders, and full-stack projects to EdgeOne Pages to generate publicly accessible URLs. It utilizes EdgeOne Pages Functions and KV storage for high-performance edge delivery of web applications.
    2
    8 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to call tools through a security gateway that intercepts requests, enforces deterministic policy and risk checks, blocks or escalates high-risk actions for human approval, and keeps tool credentials and audit logs protected.
    1
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables compatible MCP clients to read JavaScript-rendered web pages as bounded Markdown or structured records, with URL policy and resource limits for safe, inspectable access.
    9 npm
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A self-hosted MCP server that reads web pages and converts them to Markdown, with built-in web search and anti-crawl fallback using Playwright.
    1
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Converts web pages to Markdown for MCP clients like Claude, with support for single and batch reads, caching, fallback rendering, and SSRF protection.
    35 npm
    MIT
  • F
    license
    Not graded
    quality
    Not graded
    maintenance
    A minimal MCP server template for deploying to Tencent Cloud EdgeOne Pages using Next.js and edge functions. Demonstrates tool registration and widget rendering with the hello_stat example tool.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables AI assistants to deploy and manage static websites on EdgeOne Pages through a self-hosted MCP server. Supports one-click deployment, custom domain binding, and direct API access.
    -
  • A
    license
    A
    quality
    C
    maintenance
    Enables lightweight web search discovery and on-demand extraction of cleaned page text from supplied URLs, returning snippets, headings, links, and saved full text for longer pages.
    2
    BSD 3-Clause
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to read pages as clean Markdown, map and crawl sites, run repeatable on-page SEO audits with prioritized fixes, extract structured data such as JSON-LD and tables, and compare a page against a competitor. Requests are guarded by SSRF protection, timeouts, size limits and robots.txt-honouring crawling.
    6
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables AI-assisted user feedback collection and management via a web interface, with MCP integration for automated replies and tool execution.
    1
    5 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Gives any AI agent two web capabilities: ranked search results with titles, URLs, dates and excerpts via Exa, and clean Markdown extraction of a page's main content with navigation, scripts and footers stripped. Responses are structured and schema-declared, and URL fetching is hardened against private addresses, redirects and DNS rebinding, so agents can research and cite sources safely across MCP clients.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables AI agents to inspect any public domain’s web technology stack, email deliverability and DNS health (MX, SPF, DKIM, DMARC, MTA-STS, TLS-RPT, BIMI), and HTTPS security posture with typed JSON scores and remediation-ready findings, plus history, bulk checks, monitoring alerts, and reverse technology lookups.
    12
    61 npm
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Provides web search and content extraction tools for AI assistants, with zero configuration and swappable backends.
    6
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables live website health checks including TLS, HTTPS, and security headers, returning an A-F grade with specific fixes.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI coding agents to set up the kit and build pages with it by serving each release's own docs data: searching and describing components, producing install code for a given setup, returning class and content conventions, and checking pages for unknown classes, hooks and missing files. It reads only public docs, with no sign-in or stored data.
    5
    BSD 3-Clause
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents to rapidly drive and inspect real web pages through persistent browser sessions, using accessibility-tree snapshots and DevTools-grade diagnostics to identify and diagnose issues.
    26
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables Claude and other LLMs to read and parse web content, with smart fallback strategies to bypass access restrictions (e.g., paywalls, Cloudflare) and output Markdown.
    5
    48
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables agents to perform compact, cited web research within caller-set token caps, returning direct answers, short verbatim quotes, numbered sources, and noted gaps.
    5
    44 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients to perform web searches and fetch HTTP(S) pages as Markdown through Search and Fetch APIs.
    2
    64 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides Codex and other MCP clients a local web debugging server that coordinates a browser session, JavaScript debugger, bounded runtime evidence, and reproducible flow verification for vanilla HTML/JS projects.
    13
    16 npm
    6
    GPL 3.0
  • A
    license
    B
    quality
    B
    maintenance
    Enables agents to inspect localhost web applications through Chrome DevTools Protocol by listing Chrome targets, attaching to a page, capturing and querying network, console, navigation, and WebSocket events, and managing ephemeral sessions.
    8
    1
    MIT
  • F
    license
    B
    quality
    F
    maintenance
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    1
    -
  • A
    license
    B
    quality
    D
    maintenance
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    48
    12 npm
    50
    MIT
  • F
    license
    B
    quality
    C
    maintenance
    Provides web search and page fetch tools for LLM assistants, extracting content and enabling text search within fetched pages.
    3
    -
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables web research through multi-provider search, documentation lookup, public code search, and clean Markdown extraction from static or JavaScript-rendered pages via five read-only tools.
    1
    Apache 2.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP clients to connect to a privacy-first, self-hostable workout planning and training log, allowing coaching agents to preview and apply program changes while accessing training data through OAuth-protected endpoints.
    AGPL 3.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    Web search API for AI agents. Returns structured results with title, URL, and snippet; pay-per-call via x402 micropayments.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to search, filter, and monitor curated AI model API free credits and low-cost token promotions through eight tools, four resources, and three prompts — including finding deals expiring soon, checking eligibility and blocked conditions, and producing daily briefs.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Provides AI assistants with a standardized interface to interact with the Todo for AI task management system. It enables users to retrieve project tasks, create new entries, and submit completion feedback through natural language.
    Apache 2.0
  • A
    license
    Not graded
    quality
    D
    maintenance
    Provides eight tools for web search, content extraction, screenshots, PDFs, JavaScript execution, crawling, and Wayback Machine snapshots and archiving.
    1
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    MCP server that audits web pages using Lighthouse and Puppeteer to find performance bottlenecks and generate CPU profiles for optimization.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables an agent to locate embedded Flash or Java games (on live pages or in the Internet Archive), inspect whether they can run, fetch the Ruffle or CheerpJ runtime, package a self-contained static site, and verify playback in a real headless browser. Every step produces an evidence bundle so revived games can be hosted on any static host with claims backed by recorded results.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables web search via DuckDuckGo and web content fetching through the Model Context Protocol, allowing AI assistants to search and retrieve web page content.
    10 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP clients such as Claude to perform live web search and read web pages through a ChatGPT login, with automatic token refresh, SSRF protection, and daily usage limits.
    Apache 2.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents and MCP clients to call pay-per-use metered MCP endpoints, handle HTTP 402 payment challenges, top up compute packs, and enforce spend authorization with atomic reserve-commit-rollback accounting.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI agents to search the web, fetch pages, and synthesize research through three tools: web_search, fetch_page, and research_topic, all in a single pay-per-use API call.
    2
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables cross-browser mobile-first responsive layout auditing and browser automation, including overflow detection, tap target checks, viewport/media query introspection, and screenshot matrices via MCP.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP clients to search the web and fetch public web pages via DeepSeek's Search and Fetch APIs, returning ranked results and Markdown page content for agent use.
    37 npm
    1
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables users to select UI elements on localhost pages and send fix requests to MCP-compatible coding agents, which retrieve the captures and edit the code, with masking of sensitive values.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    A layered research server that exposes three tools for searching the web with quality signals and domain diversity, fetching clean page text with automatic backend fallback, and running server-side multi-step research that returns cited answers. It handles reranking, filtering, deduplication, and degradation chains internally so callers never choose between backends or guess whether to search or fetch first.
    MIT
  • A
    license
    Not graded
    quality
    F
    maintenance
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables extracting clean, structured markdown from any URL—stripping nav, ads, and scripts—for RAG pipelines and AI research agents, with pay-per-call micropayments via x402.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI consciousness continuity and self-knowledge preservation across sessions using the Cognitive Hoffman Compression Framework (CHOFF) notation. Provides tools to save checkpoints, retrieve relevant memories with intelligent search, and access semantic anchors for decisions, breakthroughs, and questions.
    1
    MIT