Skip to main content
Glama
123,436 servers. Updated
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A web crawler for collecting and indexing website content" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to read any web page as clean Markdown and inspect its metadata, structure and technology stack, plus check redirects, TLS certificates, security headers, robots.txt, sitemaps, feeds, domains, SEO, broken links, email authentication (SPF/DMARC/DKIM) and SSO (SAML/OIDC). It also provides developer utilities such as cron, regex, color, Unicode and time-zone tools along with Hyperliquid perpetuals market data, all hosted remotely on Apify with pay-per-call pricing.
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Extract content from URLs, documents, videos, and audio files using intelligent auto-engine selection. Supports web pages, PDFs, Word docs, YouTube transcripts, and more with structured JSON responses.
    2
    185
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server for crawling websites and extracting comprehensive data including images, SEO metadata, security headers, and business intelligence. It features twelve distinct extraction modes to perform detailed audits for e-commerce sites and general web analysis.
    6
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI to autonomously search, filter, and download images from the web using natural language commands, with intelligent scoring and local storage.
    1
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to analyze a piece of content across 11 dimensions and receive ranked, scored recommendations among six cross-media output formats (PPT, infographic, comic, short video script, newsletter, reusable skill), then generate dispatch prompts for the chosen format. It also exposes the format catalog and profile schema as read-only tools, supporting batch routing of an entire content library.
    1
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables interaction with Prismic through tools for reading documents, managing media assets, and performing content migrations or updates. Supports the Prismic Content, Asset, Migration, and Custom Types APIs with secure write operations and multi-transport support.
    18
    -
  • A
    license
    A
    quality
    B
    maintenance
    Enables users to look up a Douyin creator by name, public ID, or profile URL and receive the latest video link, like/comment/favorite/share counts, a full timestamped transcript with an AI-reviewed correction and change log, and a content overview. Collection, media download, and local speech transcription are orchestrated as stdio MCP tools so Codex, WorkBuddy, and other compatible clients can run creator research and scheduled checks without extra API keys.
    7
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables local discovery of research topics, interviews users to uncover their unique perspective, and turns insights into content ideas and short-form Reel scripts.
    10
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables site-wide crawling of internal links with BFS traversal, time/title/URL filtering, and page operations like summarization and link clicking, with results persisted to SQLite.
    6
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients like Claude to query Chinese A-share market data, including K-line charts with forward/backward adjustment, limit-up and limit-down pools, per-stock fund flows, index quotes, and stock news, with automatic symbol normalization and retry handling for throttled data sources.
    6
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Provides A-share (Chinese stock market) quantitative analysis through tools for stock screening, northbound capital flow tracking, dragon-tiger list analysis, margin trading, sector analysis, technical indicators, IPO info, and limit-up/down statistics using akshare data.
    11
    2
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    An MCP server that enables agents to safely interact with CMS content, with deny-by-default write policies, type/field allowlists, and structured audit trails.
    5
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Enables AI agents to read and edit a Django site's content over its API, creating tools at startup from whatever resources the site registers so no code changes are needed. Works with any site running django-agent-content, with HTTPS-only API key authentication and no delete operations.
    1
    100 PyPI
    3
    MIT
  • A
    license
    C
    quality
    C
    maintenance
    提供A股实时行情、历史K线、财务报表、技术指标等全方位数据查询的MCP服务器,支持盘中即时更新及批量查询。
    67
    29
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI coding agents to request a second opinion from a different frontier model via a single tool call, with PII scrubbed before transit, live web search, and support for Claude, ChatGPT, Cursor, and Gemini.
    Apache 2.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI chat backends to fetch public webpages and obtain cleaned readable text, Markdown, article content, metadata, and summary-ready prompts through MCP tools.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to request an independent second opinion from a different frontier model, with PII scrubbing before transit, live web search grounding, caching, and multi-provider failover.
    Apache 2.0
  • A
    license
    Not graded
    quality
    D
    maintenance
    A specialized Model Context Protocol server that enhances AI-assisted medical learning by connecting Claude Desktop to PubMed, NCBI Bookshelf, and user documents for searching, retrieving, and analyzing medical education content.
    7
    MIT
  • F
    license
    Not graded
    quality
    C
    maintenance
    Enables searching, inspecting, and downloading Italian public tender notices from the ANAC Pubblicità Legale platform, supporting offset and cursor pagination, reference data lookup, and safe third-party document retrieval.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    This MCP server provides secure access to databases for AI agents, enforcing authentication, authorization, human approval, logging, and notifications to prevent dangerous actions.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables crawling news articles by category (politics, economy, society, etc.) and generates blog-ready markdown summaries. Provides MCP tools for listing categories, crawling news, getting article details, and saving to files.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Enables web search using DuckDuckGo and content retrieval from URLs, returning markdown with pagination support.
    -
  • F
    license
    Not graded
    quality
    B
    maintenance
    Provides SEO audits, content analysis, and domain overviews through an MCP server, including on-page, technical, and authority metrics with built-in browser rendering and anti-bot handling.
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Local MCP server for A-share stock trading via Tonghuashun, offering account/position queries, buy/sell/cancel orders with risk controls and forced user confirmation; currently simulated with a reserved interface for real broker channels.
    -
  • F
    license
    Not graded
    quality
    F
    maintenance
    A lightweight MCP server implementation that provides a simple tool for fetching website content, demonstrating how tools can be exposed and interacted with using the MCP protocol.
    -
  • F
    license
    Not graded
    quality
    B
    maintenance
    Enables tracking webpage content and price changes over time, including diffs, historical records, and alerts. Supports protected pages with automated browser rendering and anti-bot handling.
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    Provides an MCP server with tools for managing a social media content calendar, including adding, listing, and updating content items, plus webhook notifications to team channels.
    -
  • A
    license
    A
    quality
    C
    maintenance
    A web-fetch MCP server for LLM agents that fetches pages with an escalation ladder through different engines, raising FetchBlocked instead of returning blocked content.
    2
    3
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    34 PyPI
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides LLMs with real-time web search and content extraction capabilities, including text/news search, full-text URL reading, and targeted technical documentation search.
    3
    25
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    An MCP server that enables AI agents to pause and request human approval or information via Slack, Telegram, or macOS dialogs before proceeding with actions.
    2
    15
    Apache 2.0
  • F
    license
    A
    quality
    B
    maintenance
    Odysseus Web MCP is a standalone Model Context Protocol (MCP) server for safe public-web search and URL fetching.
    2
    -
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Read-only MySQL MCP server that lets AI agents list tables, describe schemas, and run SELECT/SHOW/EXPLAIN queries with a row cap, bound to a single database for safety.
    3
    MIT
  • F
    license
    A
    quality
    C
    maintenance
    Enables a locally-run LLM to search the web, fetch pages as markdown, make arbitrary HTTP requests, and optionally render pages with headless Chromium.
    3
    -
  • A
    license
    A
    quality
    B
    maintenance
    Gives AI agents local web search and page reading with no API keys, layering a SearXNG-backed search cache with browser-based fallbacks and returning clean page text from HTML, PDF, JSON, and archived snapshots. Fetches run in Docker alongside the search engine with SSRF protection, egress filtering, and untrusted-content marking so agents can safely retrieve live web data.
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A fault-tolerant, stealth-enabled Model Context Protocol (MCP) server for web searching and content fetching. Built for AI Agents (Cursor, Claude Code, OpenCode), it uses a stealth browser engine to fetch pages, dynamically handles SPAs/React, and converts bloat into token-optimized Markdown.
    2
    14 npm
    20 PyPI
    4
    MIT