Skip to main content
Glama
124,040 servers. Updated
Browse by product
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A web crawler for collecting and indexing website content" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    Not graded
    quality
    C
    maintenance
    Provides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.
    13 npm
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.
    3
    -
  • A
    license
    A
    quality
    D
    maintenance
    Web-crawler MCP server that fetches web pages with static parsing or headless browser fallback, enabling Claude to fetch, extract links, crawl sites, and select content via CSS selectors.
    4
    ISC
  • A
    license
    Not graded
    quality
    B
    maintenance
    Fetches web pages politely (it obeys robots.txt and sends one request at a time to each site), keeps them in a local store, and lets the client search them and verify quotes. Nine tools for Claude and other MCP clients.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A specialized web crawler and scraper for the US Patent and Trademark Office (USPTO) website, built with Crawl4AI and MCP integration, enabling patent and trademark search, extraction, and status checking.
    4
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables crawling sites from start URLs and retrieving internal and external links, file download links, HTML tables as rows, and lists, with controls for crawl depth, page limits, sitemaps, robots.txt, and proxy mode.
    1
    110 npm
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Enables comprehensive website SEO analysis including crawling, on-page audits, site structure visualization, and content topic classification with taxonomy mapping.
    7
    1
    -
  • A
    license
    A
    quality
    C
    maintenance
    Enables reading and sending messages in Google Messages for web through a paired Chrome tab using chromefile, with tools for status, listing conversations, reading message history, and sending texts.
    4
    MIT
  • A
    license
    A
    quality
    F
    maintenance
    A comprehensive website crawler and SEO analyzer that stores site data in a local SQLite database for AI-driven auditing. It enables users to detect technical SEO issues, broken links, and security vulnerabilities through natural language queries or terminal commands.
    4
    61 npm
    16
    Apache 2.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    Lets a content team edit a GitHub-hosted website's Markdown pages and blog posts through Claude, with each change validated and committed to a staging branch. Editors can preview, publish live, or discard changes, while code checks block edits that would break the site.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to call tools through a security gateway that intercepts requests, enforces deterministic policy and risk checks, blocks or escalates high-risk actions for human approval, and keeps tool credentials and audit logs protected.
    1
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables LLM clients to index Java, Python, TypeScript, and JavaScript projects into a persistent property graph and query callers, callees, execution paths, virtual dispatch, aspect advice, framework wiring, annotations, and external dependencies through MCP tools.
    715 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    AutomateLab Content Distribution publishes content across DEV.to, Hashnode, GitHub Discussions, Reddit and Bluesky, with browser workflows for LinkedIn, Medium and X. Tracks publishing state and adapts content per platform. Product and documentation: https://automatelab.tech/products/mcp/content-distribution-mcp/
    8
    74 npm
    4
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Fast, token-efficient web content extraction tool that converts websites to clean Markdown for AI agents, featuring smart caching, content extraction with Mozilla Readability, and polite crawling capabilities.
    1
    1,450 npm
    163
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    This server performs a comprehensive analysis of a website by fetching its HTML and scoring it across five categories: performance, SEO, design, functionality, and technology. It enables users to identify technical strengths and weaknesses in a webpage's structure and health.
    2
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A server that leverages Cloudflare Browser Rendering to extract and process web content for use as context in LLMs, offering tools for fetching pages, searching documentation, extracting structured content, and summarizing content.
    4
    12
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Enables any MCP-capable agent to run a local content pipeline: capture an idea, attach sources, produce drafted newsletter and social copy, then fact-check citations, split X threads, and render newsletter HTML plus ready-to-post social packs. Keeps voice, sources, drafts, and calendar state in a local project folder with approval-gated sending and no LLM calls of its own.
    33
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
    14 npm
    1
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to fetch and crawl web pages, strip noise, and convert content into clean Markdown with preserved links for token-efficient scraping and downstream processing.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents and MCP clients to fetch web pages and crawl sites locally, converting content into clean Markdown with preserved links, caching, robots.txt compliance, and minimal token usage.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents and LLM pipelines to fetch and crawl web pages, extract readable content, and convert it into clean Markdown with preserved links while minimizing token usage.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Fetches web pages, strips noise, and converts them to clean Markdown with preserved links and optional multi-page crawling, enabling token-efficient web content extraction for AI agents and LLM pipelines.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Fetches webpages or crawls sites locally, strips noise, and converts content to clean Markdown while preserving links, enabling fast, token-efficient web scraping for AI agents and LLM pipelines.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Fetches webpages—and optionally crawls linked pages up to a configurable depth—then strips noise and converts the content into clean, token-efficient Markdown with links preserved. It caches results, respects robots.txt, and streams content for low memory use, making it suited for feeding AI agents, IDEs, and LLM pipelines readable web content.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Fetches web pages locally, strips noise, and converts them into clean, link-preserving Markdown so AI agents and IDE clients can crawl and extract web content with minimal token and memory overhead.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Fetches webpages and crawls sites locally, stripping noise and converting content into clean, link-preserving Markdown with a minimal token footprint. Supports configurable crawl depth, concurrency, robots.txt compliance, and caching for efficient AI agent and LLM pipelines.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Korean-content MCP that consolidates real-time trends from Naver, Daum, Google, YouTube, and Zum, includes a 100+ Korean holiday database, and provides a viral-score predictor for content optimization.
    81 npm
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to fetch web pages, strip noise, and convert content into clean Markdown with link preservation, caching, and configurable crawling for token-efficient scraping.
    MIT
  • F
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to fetch web pages locally, strip noise, and convert content to clean Markdown while preserving links, with caching and optional multi-page crawling for token-efficient scraping.
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    Provides a local MCP stdio service that lets AI agents claim web clippings—selected text, images, media ranges—stored by the extension, process them, and write back outputs. It bridges the Chrome extension's local data to user-controlled agents via Native Messaging.
    -
  • F
    license
    Not graded
    quality
    A
    maintenance
    Enables AI agents to quickly fetch webpages, strip noise, and convert content into clean, link-preserving Markdown with caching and optional multi-page crawling for token-efficient web scraping.
    -
  • A
    license
    A
    quality
    A
    maintenance
    Enables AI agents to check a list of websites by running an Apify Actor through one tool, returning per-site tech stack, on-page SEO issues and score, robots.txt rules for AI crawlers, sitemap, llms.txt presence, and an AI-readiness score. Supports local stdio operation with an Apify token for tool calls.
    8
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Classifies company sites as B2B or B2C and as SaaS, online store, agency, manufacturer, wholesaler, distributor, or marketplace, while matching your own buyer phrases and returning the quoted text and page as evidence. Runs deterministically on Apify, giving one row per domain with grace-free status rows for unreachable, blocked, or empty sites.
    1
    128 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables agents to search the live web and fetch URLs as clean Markdown, returning ranked search results and paginated page content through two lightweight tools.
    2
    23 npm
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides AI-visibility scoring and site auditing capabilities for websites, enabling agents to check how sites appear in AI engines like ChatGPT and Perplexity, run full SEO/security audits, and monitor changes over time.
    20
    464 npm
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables extraction of structured item lists from public web pages using the user's own OpenAI, Anthropic, Gemini, or Groq key through an Apify actor, returning one row per item with validation flags.
    1
    126 npm
    MIT