Skip to main content
Glama
124,488 servers. Updated
Browse by product
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A search for information about deep crawl web crawling and site auditing tools" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • A
    license
    A
    quality
    C
    maintenance
    MCP server for web crawling, searching, and AI-powered content extraction, supporting single-page, batch, and full-site crawling along with text, news, image, book, and video search.
    8
    31 PyPI
    1
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Provides a web search tool with citations by running Claude Code CLI in an isolated Docker container, enabling search even in environments without direct Anthropic web search support.
    1
    -
  • A
    license
    B
    quality
    B
    maintenance
    Unofficial MCP server wrapping crawl4ai that enables extraction and analysis of content from web pages, PDFs, Office documents, YouTube videos, and more, with AI-powered summarization and Google search integration to reduce token usage while preserving key information.
    21
    49
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    An open-source deep research MCP server that provides multi-source web search and synthesis with citations, enabling agents to perform citation-backed research using Qwen3-30B-A3B-Thinking and other models.
    6
    66
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that provides Google Analytics and Search Console data as tools for AI assistants, enabling natural language queries for web analytics, SEO performance, and site insights.
    13
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Provides an LLM client with self-hosted web scraping capabilities including scraping, crawling, mapping, searching, structured data extraction, browser interaction, and deep research, without reliance on paid proxy or CAPTCHA services.
    4
    GPL 3.0
  • A
    license
    B
    quality
    C
    maintenance
    Provides A-share (Chinese stock market) quantitative analysis through tools for stock screening, northbound capital flow tracking, dragon-tiger list analysis, margin trading, sector analysis, technical indicators, IPO info, and limit-up/down statistics using akshare data.
    11
    2
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Connect AI assistants to your Gramps Web family tree. Search and edit genealogy records, explore ancestors, descendants, relationships and timelines, and read document scans with vision-capable models. Includes guided research workflows, source citations, read-only mode, and privacy-aware media previews. Install with Docker or a Claude Desktop bundle.
    2
    35
    23
    AGPL 3.0
  • A
    license
    A
    quality
    A
    maintenance
    MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.
    25
    79
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables AI-assisted user feedback collection and management via a web interface, with MCP integration for automated replies and tool execution.
    1
    5 npm
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables AI agents to inspect any public domain’s web technology stack, email deliverability and DNS health (MX, SPF, DKIM, DMARC, MTA-STS, TLS-RPT, BIMI), and HTTPS security posture with typed JSON scores and remediation-ready findings, plus history, bulk checks, monitoring alerts, and reverse technology lookups.
    12
    61 npm
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that enables AI assistants to perform web searches on Perplexity.ai using browser automation instead of an official API. It supports persistent authenticated sessions and returns search results along with cited sources directly to the client.
    3
    46 npm
    14
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables web search, page fetching, and search statistics for Claude Code and any MCP client without requiring an API key, using automatic provider fallback and caching.
    3
    MIT
  • A
    license
    A
    quality
    F
    maintenance
    Search and resolve MCP server packages on the mpak registry, enabling agents to discover servers, inspect tools, and check credential requirements before installation.
    2
    MIT
  • A
    license
    A
    quality
    F
    maintenance
    MCP server for querying Google Gemini Web from Claude Code and other MCP clients, using cookie-based authentication. Enables creating, continuing, listing, viewing, and deleting Gemini chat conversations with model and thinking mode control.
    6
    AGPL 3.0
  • F
    license
    A
    quality
    D
    maintenance
    A local web search MCP server supporting parallel, API, and model-based search modes, integrating Zhipu Web Search API and online models for real-time information retrieval.
    10
    -
  • A
    license
    A
    quality
    B
    maintenance
    Enables running web searches across multiple engines like Google, Bing, DuckDuckGo, Yahoo! JAPAN, and Brave via Playwright, with tools to fetch page content and manage browser profiles.
    5
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables agents to perform local metasearch, scholarly and code/model lookups, and fetch rendered web pages or PDFs as paginated markdown, including stealth browsing and arXiv paper overviews.
    11
    MIT
  • A
    license
    B
    quality
    D
    maintenance
    An MCP server for global tech intelligence gathering, offering tools for searching Chinese and English web content, GitHub trending, arXiv papers, HN, Exa, SEC filings, Juejin, Zhihu, Bilibili, and A-share financial reports, all without API keys and with direct China access.
    15
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Fetches a URL and returns the main content as clean Markdown, using plain HTTP when possible and headless Chromium for JavaScript-rendered or bot-protected pages.
    1
    21 PyPI
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Web search for AI agents via Google Search grounding through Gemini: returns answers with cited sources and the passages each source supports. Self-hosted alternative to Tavily, Exa and Perplexity Sonar, using your own Gemini API key.
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Bridges the editing capabilities of an already-open DingTalk document in the browser to any MCP host via standard stdio, forwarding tools to the page's internal MCP server over a local WebSocket. Supports read/write operations through suggested edits, pairing-based security, and zero runtime dependencies.
    5
    22 npm
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables AI assistants to search JLCPCB's 450K+ electronic component catalog with real-time stock levels and pricing, supporting keyword search, filtering, and detailed component information.
    4
    38 PyPI
    9
    -
  • A
    license
    A
    quality
    C
    maintenance
    Enables natural-language search over locally indexed files such as markdown, text, images, videos, and PDFs, and retrieves indexed text or media metadata by path. It lets Cursor query a local embedding index built with Gemini and SQLite.
    2
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables Brave Search via MCP, deployed on Railway for seamless integration with AI agents.
    6
    -
  • A
    license
    A
    quality
    D
    maintenance
    An MCP server that exposes an Agno agent with Google Gemini reasoning and Serper web search, enabling MCP-compatible clients like Claude Desktop to perform agent-driven web searches and receive synthesized answers.
    1
    2
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Gives LLM agents spatial awareness inside Autodesk Maya, enabling scene inspection and measurement, aesthetic and engineering audits, camera planning, checkpoint/rollback safety, asset import, and viewport or render previews. Agents can also execute arbitrary Python in Maya to build and verify 3D scenes against engineering rules instead of writing blind.
    25
    94 PyPI
    7
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    A lightweight MCP server providing common utility tools such as unit conversion, password generation, date calculation, hashing, Base64 encoding/decoding, UUID generation, text case conversion, and text statistics, with no external dependencies.
    8
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables semantic search over markdown files to find related notes by meaning rather than keywords, and automatically detect duplicate content before creating new notes.
    3
    2
    BSD 2-Clause "Simplified"
  • F
    license
    A
    quality
    D
    maintenance
    Enables LLMs to search and retrieve Autotask tickets, companies, and contacts using advanced semantic search and AI-powered reranking.
    11
    2
    -
  • F
    license
    A
    quality
    D
    maintenance
    Wraps the local agy CLI into an MCP server to provide a web_search tool that enables Claude Code to perform real internet searches through Gemini/Google.
    1
    -
  • A
    license
    A
    quality
    B
    maintenance
    An MCP implementation that integrates the Brave Search API, providing comprehensive search capabilities including web, local business, image, video, news searches, and AI-powered summarization.
    9
    49,475 npm
    1,583
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables natural-language interaction with Ladybug Tools for building performance simulation, 3D modeling, and data visualization, allowing agents to perform complex environmental analysis tasks without CAD software.
    3
    12
    GPL 3.0
  • A
    license
    A
    quality
    B
    maintenance
    repo-release-tools mcp-server automates the software release process by managing version bumps, changelog generation, and releases. It streamlines repository maintenance by handling repetitive release tasks directly through your AI assistant.
    32
    1,711 PyPI
    2
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    Enables MCP clients to run web searches and fetch web page contents through DeepSeek's Search and Fetch APIs, returning structured JSON results with configurable tool names and multiple transport options.
    2
    11
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Exposes SQL Server and Snowflake schema metadata to AI coding agents, enabling schema search, join path discovery, and stored procedure metadata retrieval without live queries.
    18
    GPL 3.0
  • A
    license
    A
    quality
    D
    maintenance
    Search and explore a catalog of 2,000+ MCP servers — full-text search, trending, hot, categories, and side-by-side comparison — from any MCP client. A zero-dependency stdio bridge over the hosted awesome-mcp.tools endpoint.
    8
    10 npm
    1
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Enables AI assistants to perform controlled Linux system administration tasks like reading logs, managing services, cron jobs, WordPress, and executing sandboxed Python code, with strict security constraints.
    29
    2
    GPL 2.0
  • A
    license
    A
    quality
    C
    maintenance
    Multi-account Google Search Console MCP server enabling AI assistants to query multiple GSC accounts by name in a single session, with support for OAuth and service accounts.
    17
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Secure MCP server for Google Search Console. Query search analytics (clicks, impressions, CTR, position), manage sitemaps, inspect URL indexing status, and manage site properties.
    10
    AGPL 3.0