Skip to main content
Glama
125,092 servers. Updated
Browse by product
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A server for crawling web pages and finding subpages" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • F
    license
    A
    quality
    D
    maintenance
    Exposes two MCP tools (discover and execute) that enable agents to query an OpenAPI schema via natural language and execute matched API operations.
    2
    -
  • F
    license
    A
    quality
    C
    maintenance
    Enables a locally-run LLM to search the web, fetch pages as markdown, make arbitrary HTTP requests, and optionally render pages with headless Chromium.
    3
    -
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients like Claude to query Chinese A-share market data, including K-line charts with forward/backward adjustment, limit-up and limit-down pools, per-stock fund flows, index quotes, and stock news, with automatic symbol normalization and retry handling for throttled data sources.
    6
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Enables AI agents to list managed Pages and read Page details, posts, comments, photos, videos, events, Messenger conversations, and Insights, with optional publishing, commenting, media upload, and deletion gated behind configurable permission tiers. Runs over stdio or Bearer-token-protected streamable HTTP, with Docker support for remote deployment.
    22
    MIT
  • A
    license
    B
    quality
    C
    maintenance
    Provides A-share (Chinese stock market) quantitative analysis through tools for stock screening, northbound capital flow tracking, dragon-tiger list analysis, margin trading, sector analysis, technical indicators, IPO info, and limit-up/down statistics using akshare data.
    11
    2
    MIT
  • A
    license
    C
    quality
    C
    maintenance
    提供A股实时行情、历史K线、财务报表、技术指标等全方位数据查询的MCP服务器,支持盘中即时更新及批量查询。
    67
    29
    MIT
  • F
    license
    A
    quality
    C
    maintenance
    A local MCP server that gives Claude Code web search capabilities using DuckDuckGo, enabling discovery of URLs from natural language queries.
    1
    1
    -
  • A
    license
    A
    quality
    C
    maintenance
    MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    A web-fetch MCP server for LLM agents that fetches pages with an escalation ladder through different engines, raising FetchBlocked instead of returning blocked content.
    2
    3
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables reading Slack channels, messages, and threads using the web interface via a persistent browser session, designed for guest users without API access. Does not send messages.
    5
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    An MCP server that enables AI agents to pause and request human approval or information via Slack, Telegram, or macOS dialogs before proceeding with actions.
    2
    9 PyPI
    15
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP clients to search the web through DuckDuckGo, Google News, and Wikipedia, and to fetch readable text or pretty-printed JSON from web pages without API keys, accounts, or configuration.
    2
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Read-only MySQL MCP server that lets AI agents list tables, describe schemas, and run SELECT/SHOW/EXPLAIN queries with a row cap, bound to a single database for safety.
    3
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Provides programmatic access to Material Web documentation and components for AI agents, enabling documentation search, template generation, and HTML validation.
    7
    57 npm
    1
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables models to run web searches through DuckDuckGo and to fetch and extract the readable text of public pages, with bounded result counts, character limits and URL safety checks. It exposes two simple tools over stdio, requiring no API keys, ports or persistent processes.
    2
    Apache 2.0
  • A
    license
    A
    quality
    B
    maintenance
    Gives AI agents local web search and page reading with no API keys, layering a SearXNG-backed search cache with browser-based fallbacks and returning clean page text from HTML, PDF, JSON, and archived snapshots. Fetches run in Docker alongside the search engine with SSRF protection, egress filtering, and untrusted-content marking so agents can safely retrieve live web data.
    2
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Provides web access capabilities for LLMs including search, fetching, content extraction, PDF reading, image viewing, and screenshots.
    3
    33 PyPI
    46
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides an LLM client with self-hosted web scraping capabilities including scraping, crawling, mapping, searching, structured data extraction, browser interaction, and deep research, without reliance on paid proxy or CAPTCHA services.
    4
    GPL 3.0
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP-capable agents to perform local web research under a declared plan with session budgets, user-approved limit extensions, and guardrails for safe searching, page fetching, content extraction, and audit logging.
    4
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables agents to perform local metasearch, scholarly and code/model lookups, and fetch rendered web pages or PDFs as paginated markdown, including stealth browsing and arXiv paper overviews.
    11
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Persists web fetch and search results as timestamped JSONL files, indexed for full-text search, enabling users to retrieve and search across archived web pages even after they are removed or changed.
    17
    -
  • F
    license
    A
    quality
    D
    maintenance
    Provides a web search tool with citations by running Claude Code CLI in an isolated Docker container, enabling search even in environments without direct Anthropic web search support.
    1
    -
  • A
    license
    A
    quality
    C
    maintenance
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    14
    9
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides Codex and other MCP clients a local web debugging server that coordinates a browser session, JavaScript debugger, bounded runtime evidence, and reproducible flow verification for vanilla HTML/JS projects.
    13
    16 npm
    6
    GPL 3.0
  • A
    license
    A
    quality
    C
    maintenance
    A local MCP server for semantic search over RSS/Atom feeds, providing tools for ranked search, trending topics, digests, and feed health monitoring without requiring an API key.
    9
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    A local MCP server providing web search, page extraction, and safe browser automation tools for Hermes, Claude Code, and other MCP clients.
    10
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Enables agents to fetch web pages as clean Markdown, inspect metadata, extract links, analyze tech stacks, and audit or compare SEO, with per-call billing and automatic refunds for failed fetches.
    8
    Business Source 1.1
  • A
    license
    B
    quality
    D
    maintenance
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    48
    12 npm
    50
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.
    1
    21 PyPI
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    An open-source MCP server providing AI agents with neural web search via Exa and tiered web fetch (Exa, local browser, Firecrawl) as a drop-in replacement for built-in web tools, preserving provenance and guarding against SSRF.
    6
    9
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Bridges the editing capabilities of an already-open DingTalk document in the browser to any MCP host via standard stdio, forwarding tools to the page's internal MCP server over a local WebSocket. Supports read/write operations through suggested edits, pairing-based security, and zero runtime dependencies.
    5
    22 npm
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Connect AI assistants to your Gramps Web family tree. Search and edit genealogy records, explore ancestors, descendants, relationships and timelines, and read document scans with vision-capable models. Includes guided research workflows, source citations, read-only mode, and privacy-aware media previews. Install with Docker or a Claude Desktop bundle.
    2
    35
    23
    AGPL 3.0
  • A
    license
    A
    quality
    B
    maintenance
    Enables MCP-capable agents to perform reliable web search and content fetching through a single server that automatically fails over across multiple providers. It handles keyed or keyless authentication automatically and returns clean Markdown or text results.
    3
    1
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Enables AI agents to perform local video, audio, and file operations inside an isolated workspace, including cutting/concat videos, extracting audio, transcribing, and managing files, with typed responses and background job support.
    11
    1
    -
  • A
    license
    A
    quality
    B
    maintenance
    Provides LLMs with real-time web search and content extraction capabilities, including text/news search, full-text URL reading, and targeted technical documentation search.
    3
    25
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables AI assistants to run Perplexity searches—including Pro, reasoning, deep research, and academic modes—through your own logged-in perplexity.ai browser session, with no API key required. Answers come back as Markdown with numbered sources.
    1
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.
    25
    79
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables AI agents and autonomous workflows to run Google searches and extract high-density, token-efficient Markdown from webpages using stealth browser automation, with SSRF protection and health monitoring.
    3
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Gives LLM agents spatial awareness inside Autodesk Maya, enabling scene inspection and measurement, aesthetic and engineering audits, camera planning, checkpoint/rollback safety, asset import, and viewport or render previews. Agents can also execute arbitrary Python in Maya to build and verify 3D scenes against engineering rules instead of writing blind.
    25
    7
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    This MCP server enables free web search and page content extraction using real browsers, with support for multiple search engines and stealth browser backends. It provides tools for searching, fetching pages, and setting up the Camoufox stealth browser.
    3
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    A portable MCP server that scrapes SPA/JS-rendered webpages and extracts structured API endpoint data. It uses headless Chromium to render JavaScript and provides tools for scraping, endpoint extraction, screenshots, and database seeding.
    4
    1
    -