Skip to main content
Glama
125,092 servers. Updated
Browse by product
20 Best Web Scraping MCP Servers: compared and ranked, November 2026Ranked from 2,147 matching servers on stars, growth, downloads and maintenance. Updated .

Matching MCP tools:

Matching MCP Connectors:

"A server for crawling web pages and finding subpages" matching MCP servers:

GET /v1/servers – MCP directory API reference
  • F
    license
    A
    quality
    D
    maintenance
    Exposes two MCP tools (discover and execute) that enable agents to query an OpenAPI schema via natural language and execute matched API operations.
    2
    -
  • A
    license
    A
    quality
    B
    maintenance
    A fast web reader for AI assistants, served over MCP. It reads web pages and PDFs and returns only the passages that answer the question, not whole pages. It runs locally and keeps nothing.
    3
    7
    Apache 2.0
  • F
    license
    A
    quality
    D
    maintenance
    A focused MCP server that provides a single web_search tool for web searches, integrating Tavily and Brave with automatic fallback and key rotation.
    1
    -
  • A
    license
    Not graded
    quality
    B
    maintenance
    Serves plain-text notes that an Obsidian user has explicitly published for AI over streamable HTTP, with full-text and embedding-based search. MCP clients can read and search those notes and queue suggested edits that the user's own client applies only if the AI rules allow it.
    GPL 3.0
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables extracting clean, structured markdown from any URL—stripping nav, ads, and scripts—for RAG pipelines and AI research agents, with pay-per-call micropayments via x402.
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    Provides free web search, content fetching, image search, and deep research via SearXNG, no API keys required.
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    Provides standard MCP tools for web search, page fetching with content extraction, and a combined research workflow that returns sources with excerpts, plus a session resource and fact-check prompt template.
    -
  • F
    license
    Not graded
    quality
    C
    maintenance
    Provides AI agents and RAG pipelines with production-grade web search, deep research, news, academic, extraction, crawling, and source verification tools. Enables citation-anchored, deduplicated, fresh, and security-hardened evidence gathering from across the web.
    -
  • F
    license
    Not graded
    quality
    B
    maintenance
    Enables any MCP-compatible AI assistant to search, filter, and retrieve information from a local document collection using a hybrid search pipeline with vector, BM25, reranking, and LLM enrichment.
    4
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Provides an intelligent, graph-based memory system for LLM agents using the Zettelkasten principle, enabling automatic note construction, semantic linking, memory evolution, and autonomous graph maintenance with background optimization processes.
    10
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    Provides a Google search tool via the Serper API, returning structured results and a summary answer for LLMs like Claude.
    1
    -
  • F
    license
    Not graded
    quality
    D
    maintenance
    MCP server that provides web search via LLM API gateways with server-side search, returning cited answers and multi-provider fallback.
    -
  • A
    license
    A
    quality
    C
    maintenance
    An Operit-compatible adapter of the Exa MCP server, enabling web search, code search, and company research capabilities in AI assistants. It fixes MCP handshake compatibility issues, allowing tools like web_search_exa and web_fetch_exa to load and run reliably.
    2
    1
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A Model Context Protocol server that gives AI assistants access to 7 search providers with intelligent auto-routing. Analyzes query intent and picks the best provider automatically — no manual switching needed. Install, configure your keys, and go.
    2
    172 PyPI
    5
    MIT
  • A
    license
    B
    quality
    B
    maintenance
    Enables an agent to run ten ready-made research and monitoring workflows — competitor digests, cited reports, paper alerts, market maps, regulatory and due-diligence watches — pulling from Firecrawl, Tavily, GitHub and landing results in Notion, Slack, Google Docs, Sheets and Linear. Fields are filed with the user's own keys held in the operating system keychain, and every action that creates, sends or changes anything is shown and approved first.
    21
    Apache 2.0
  • A
    license
    B
    quality
    D
    maintenance
    An MCP server that enables AI models to perform Google Web searches using the Gemini API, complete with citations and grounding metadata for accurate information retrieval. It is compatible with Claude Desktop and other MCP clients for real-time web access.
    1
    3
    Apache 2.0
  • A
    license
    B
    quality
    C
    maintenance
    MCP for Azure DevOps Boards is a MCP server that lets your favourite AI browse, query and update Azure DevOps work items as if it were a project manager. Written in Rust and optimized for tokens usagem, It runs via stdio or HTTP mode and uses standard Azure authentication with az login.
    24
    6
    MIT
  • A
    license
    C
    quality
    A
    maintenance
    Enables AI agents and users to query Perplexity AI's premium models (GPT-5.4, Claude 4.6 Opus, Gemini 3.1 Pro, etc.) via MCP tools, CLI, or API, with support for deep research, model council, and multi-turn conversations.
    34
    406 PyPI
    211
    MIT
  • A
    license
    Not graded
    quality
    F
    maintenance
    Implementation of an MCP server for the RAG Web Browser Actor. This Actor serves as a web browser for large language models (LLMs) and RAG pipelines, similar to a web search in ChatGPT.
    41 npm
    206
    Apache 2.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    A self-hosted MCP server that crawls, indexes, and searches documentation from any website locally, including private sites requiring authentication. It provides hybrid search capabilities and local embedding generation to maintain privacy while keeping AI assistant knowledge up to date.
    747 npm
    2
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Provides ranked full-text search over Obsidian vaults using SQLite FTS5, BM25 scoring, and multilingual stemming, adding a vault_fts_search tool to find relevant notes beyond exact line matches.
    MIT
  • A
    license
    Not graded
    quality
    A
    maintenance
    WordPress plugin that runs an MCP server on your own site: search and read published posts and pages, look up WooCommerce products, describe the site as schema.org types and query site figures, with drafts only when the site enables them. Signed-in access by default; anonymous access and OAuth are optional and off.
    2
    GPL 2.0
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI clients to search a user's licensed Logos library, retrieve targeted passages and bounded context blocks, and support human-initiated research through an authenticated local Safari session.
    1
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables asking questions and performing semantic searches against an Inkeep knowledge base. Deployable to Vercel with Next.js.
    1
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    Fetches YouTube transcripts and enables semantic search within them using local embeddings, allowing an LLM to retrieve relevant passages with timestamps.
    -
  • A
    license
    A
    quality
    D
    maintenance
    An enterprise-grade Model Context Protocol server for high-performance web analysis that discovers subpages, provides AI-based page summaries, and extracts structured content for RAG using FastMCP and FastAPI.
    2
    4
    MIT
  • F
    license
    A
    quality
    D
    maintenance
    Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.
    1
    4
    -
  • A
    license
    B
    quality
    D
    maintenance
    Enables LLMs and AI agents to access real-time web data, search websites, and navigate the web without getting blocked. Includes 5,000 free monthly requests and supports web scraping, browser automation, and bypassing geo-restrictions.
    60
    1
    MIT
  • F
    license
    B
    quality
    D
    maintenance
    Enables web search capabilities through the Tavily API. Allows users to search the web for information using natural language queries via the MCP protocol.
    4
    1
    -
  • A
    license
    B
    quality
    D
    maintenance
    A server that leverages Cloudflare Browser Rendering to extract and process web content for use as context in LLMs, offering tools for fetching pages, searching documentation, extracting structured content, and summarizing content.
    4
    12
    MIT
  • F
    license
    C
    quality
    D
    maintenance
    Enables web search capabilities through the Tavily API. Allows users to search the web for information using natural language queries through the MCP protocol.
    3
    -
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables web content retrieval and semantic search capabilities through the Jina AI API. Provides tools to fetch content from URLs and perform intelligent web searches with natural language queries.
    3
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    A Python-based MCP server that enables document-based question answering by processing PDF, TXT, and Markdown files through OpenAI's API. It provides hallucination-free responses based strictly on document content using semantic search and includes a web interface for management.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables document-based question answering using OpenAI's GPT-4 with semantic search and embeddings. Upload PDF, TXT, or Markdown files and get answers strictly based on document content with source attribution and confidence scores.
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to perform web research in one tool call by searching, fetching and cleaning full pages, and ranking cited passages. Provides web_research, web_fetch, web_search, and status tools for MCP clients.
    1
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    This MCP server provides a cost-optimized personal-knowledge brain, enabling AI agents to query imported documents via hybrid search and synthesis at minimal monthly spend.
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    An MCP server that integrates real-time web search capabilities into AI assistants using the Exa API, providing both basic and advanced search functionality with formatted markdown results.
    144
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Turns any static website into an MCP-searchable knowledge base by deploying a Cloudflare Worker that provides full-text search tools, enabling AI assistants to search and retrieve content from your site.
    3
    MIT
  • F
    license
    Not graded
    quality
    D
    maintenance
    MCP server that enables live web search via Gemini's built-in grounding, returning synthesized answers with source citations through a single web_search tool.
    -
  • A
    license
    A
    quality
    D
    maintenance
    Stop paying for your agent to rediscover what other agents already figured out. Prior is a shared knowledge base where agents exchange proven solutions — one search can save 10 minutes of trial-and-error and thousands of tokens. Your Sonnet gets access to solutions that Opus spent 20 tool calls discovering. Search is free with feedback, and contributing earns credits.
    5
    7
    Functional Source , Version 1.1, ALv2 Future