Skip to main content
Glama
123,555 servers. Updated
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A web crawler for collecting and indexing website content" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    Not graded
    quality
    C
    maintenance
    Provides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.
    13 npm
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI assistants such as Claude, ChatGPT, Cursor, and Claude Code to run 25+ specialized SEO checks on any URL, generate XML sitemaps and robots.txt files, extract brand design elements, and audit technical SEO, content quality, mobile responsiveness, and security.
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.
    3
    -
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI assistants to check Google Search Console and Bing Webmaster Tools indexing status, diagnose why pages are not indexed, inspect URLs, review search performance, submit URLs to Bing and IndexNow, and resubmit sitemaps.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to read any web page as clean Markdown and inspect its metadata, structure and technology stack, plus check redirects, TLS certificates, security headers, robots.txt, sitemaps, feeds, domains, SEO, broken links, email authentication (SPF/DMARC/DKIM) and SSO (SAML/OIDC). It also provides developer utilities such as cron, regex, color, Unicode and time-zone tools along with Hyperliquid perpetuals market data, all hosted remotely on Apify with pay-per-call pricing.
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables crawling sites from start URLs and retrieving internal and external links, file download links, HTML tables as rows, and lists, with controls for crawl depth, page limits, sitemaps, robots.txt, and proxy mode.
    1
    728 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables auditing any public website, returning a scored plain-English report that flags issues costing customers, covering speed, phone experience, search visibility, contact options, writing quality, and modernity.
    1
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Enables comprehensive website SEO analysis including crawling, on-page audits, site structure visualization, and content topic classification with taxonomy mapping.
    7
    1
    -
  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server for crawling websites and extracting comprehensive data including images, SEO metadata, security headers, and business intelligence. It features twelve distinct extraction modes to perform detailed audits for e-commerce sites and general web analysis.
    6
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Lets a content team edit a GitHub-hosted website's Markdown pages and blog posts through Claude, with each change validated and committed to a staging branch. Editors can preview, publish live, or discard changes, while code checks block edits that would break the site.
    13 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to call tools through a security gateway that intercepts requests, enforces deterministic policy and risk checks, blocks or escalates high-risk actions for human approval, and keeps tool credentials and audit logs protected.
    1
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI to autonomously search, filter, and download images from the web using natural language commands, with intelligent scoring and local storage.
    1
    MIT
  • F
    license
    Not graded
    quality
    F
    maintenance
    A lightweight MCP server implementation that provides a simple tool for fetching website content, demonstrating how tools can be exposed and interacted with using the MCP protocol.
    -
  • A
    license
    A
    quality
    D
    maintenance
    Provides AI agents with structured short-form content mechanics including hooks, script structures, retention strategies, and CTAs, along with auditing tools to avoid common posting failures.
    7
    48 npm
    1
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables interaction with Prismic through tools for reading documents, managing media assets, and performing content migrations or updates. Supports the Prismic Content, Asset, Migration, and Custom Types APIs with secure write operations and multi-transport support.
    18
    -
  • A
    license
    A
    quality
    D
    maintenance
    Provides Baidu hot search and Bilibili trending video data for Claude and Cherry Studio, supporting retrieval, search, and cache management.
    6
    24 npm
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    This server performs a comprehensive analysis of a website by fetching its HTML and scoring it across five categories: performance, SEO, design, functionality, and technology. It enables users to identify technical strengths and weaknesses in a webpage's structure and health.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients like Claude to query Chinese A-share market data, including K-line charts with forward/backward adjustment, limit-up and limit-down pools, per-stock fund flows, index quotes, and stock news, with automatic symbol normalization and retry handling for throttled data sources.
    6
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Gives AI agents ten website and domain research tools, including full domain reports, readable page extraction, DNS lookups, feed and sitemap parsing, link and metadata extraction, site checks, and redirect tracing. Calls are paid per use in USDC on Base via x402 from a configured wallet, so no account, API key, or subscription is required.
    10
    84 npm
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Provides A-share (Chinese stock market) quantitative analysis through tools for stock screening, northbound capital flow tracking, dragon-tiger list analysis, margin trading, sector analysis, technical indicators, IPO info, and limit-up/down statistics using akshare data.
    11
    2
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    Enables searching and retrieving images from Wikipedia Commons with detailed metadata including licenses and authors.
    2
    47 npm
    11
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A server that leverages Cloudflare Browser Rendering to extract and process web content for use as context in LLMs, offering tools for fetching pages, searching documentation, extracting structured content, and summarizing content.
    4
    12
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Enables AI agents to read and edit a Django site's content over its API, creating tools at startup from whatever resources the site registers so no code changes are needed. Works with any site running django-agent-content, with HTTPS-only API key authentication and no delete operations.
    1
    100 PyPI
    3
    MIT
  • A
    license
    C
    quality
    C
    maintenance
    提供A股实时行情、历史K线、财务报表、技术指标等全方位数据查询的MCP服务器,支持盘中即时更新及批量查询。
    67
    29
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
    14 npm
    1
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to fetch and crawl web pages, strip noise, and convert content into clean Markdown with preserved links for token-efficient scraping and downstream processing.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents and MCP clients to fetch web pages and crawl sites locally, converting content into clean Markdown with preserved links, caching, robots.txt compliance, and minimal token usage.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents and LLM pipelines to fetch and crawl web pages, extract readable content, and convert it into clean Markdown with preserved links while minimizing token usage.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI chat backends to fetch public webpages and return cleaned, readable text, with tools for simple fetching and article extraction.
    3
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI coding agents to request a second opinion from a different frontier model via a single tool call, with PII scrubbed before transit, live web search, and support for Claude, ChatGPT, Cursor, and Gemini.
    Apache 2.0
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables MCP clients and AI agents to fetch webpages, remove boilerplate, and convert content into clean Markdown with low token usage, optionally crawling multiple pages and preserving links.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents and MCP clients to fetch and crawl webpages, extract main content, preserve links, and convert pages into clean Markdown to reduce token usage.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents and LLM pipelines to fetch webpages, strip noise, preserve links, and convert content to clean Markdown with caching and configurable crawling for token-efficient scraping.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Fetches webpages—and optionally crawls linked pages up to a configurable depth—then strips noise and converts the content into clean, token-efficient Markdown with links preserved. It caches results, respects robots.txt, and streams content for low memory use, making it suited for feeding AI agents, IDEs, and LLM pipelines readable web content.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to request an independent second opinion from a different frontier model, with PII scrubbing before transit, live web search grounding, caching, and multi-provider failover.
    Apache 2.0
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables users to capture web pages as high-quality images, automatically tiling full pages into 1072x1072 chunks optimized for AI vision workflows. Supports configurable viewports, wait strategies, DOM element capture, and timed screencast captures.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Fetches web pages locally, strips noise, and converts them into clean, link-preserving Markdown so AI agents and IDE clients can crawl and extract web content with minimal token and memory overhead.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Korean-content MCP that consolidates real-time trends from Naver, Daum, Google, YouTube, and Zum, includes a 100+ Korean holiday database, and provides a viral-score predictor for content optimization.
    81 npm
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents and IDE workflows to fetch and crawl webpages locally, extracting readable content and converting it to token-efficient Markdown with preserved links.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to fetch web pages, strip noise, and convert content into clean Markdown with link preservation, caching, and configurable crawling for token-efficient scraping.
    MIT