Skip to main content
Glama
21,811 servers. Last updated

Matching MCP tools:

Matching MCP Connectors:

"Information about web crawlers or scraping techniques" matching MCP servers:

  • Documentation Retrieval & Web

    AIwithhassan
    A
    security
    F
    license
    A
    quality
    Enables retrieval and cleaning of official documentation content for popular AI/Python libraries (uv, langchain, openai, llama-index) through web scraping and LLM-powered content extraction. Uses Serper API for search and Groq API to clean HTML into readable text with source attribution.
    Last updated
    1
    1

  • web-scrapper-stdio

    JustAzul
    -
    security
    A
    license
    -
    quality
    A headless web scraping server that extracts main content from web pages into Markdown, text, or HTML for AI and automation integration. It features per-domain rate limiting and robust error handling using Playwright and BeautifulSoup.
    Last updated
    MIT

  • mcp-web

    TsFreddie
    -
    security
    A
    license
    -
    quality
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    Last updated
    7
    MIT

  • MCP Web Scrape

    mukul975
    A
    security
    A
    license
    B
    quality
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    Last updated
    48
    7
    7
    MIT

  • web-fetch-mcp

    xiaozhuABCD1234
    -
    security
    A
    license
    -
    quality
    An MCP server that provides web scraping and Bing search capabilities, supporting both static and dynamic content through Puppeteer. It allows AI assistants to extract page summaries, SEO metadata, and full text with automatic detection for headless browser rendering.
    Last updated

  • Web Search MCP Server

    rohanraja
    -
    security
    F
    license
    -
    quality
    Enables free web searching using Google search results without the need for API keys or authentication. It returns structured data including titles, URLs, and descriptions with configurable result limits.
    Last updated
    45

  • MCP Web Tools

    SayreBlades
    A
    security
    F
    license
    A
    quality
    Provides local web search and content fetching capabilities for AI assistants, enabling them to search DuckDuckGo and extract clean text from web pages. All requests originate from the user's machine to ensure direct network control and bypass external proxies.
    Last updated
    2

  • MCP Web Scraper Server

    Aniruddha1202
    -
    security
    F
    license
    -
    quality
    An advanced web search and scraping server that enables AI models to perform targeted DuckDuckGo searches and extract clean content, tables, and metadata from webpages. It provides specialized tools for news discovery, link extraction, and comprehensive search-and-scrape workflows.
    Last updated
    • Apple

  • Web Resource Ledger

    benpeter
    -
    security
    F
    license
    -
    quality
    πŸ“‡ ☁️ - Capture web pages as cryptographically signed, tamper-evident evidence. Ed25519 signatures, RFC 3161 timestamps, and WACZ archives. Four tools: capture_url, get_capture, list_captures, verify_capture.
    Last updated
    0
    1

  • mcp-web-calc

    tickernelz
    A
    security
    A
    license
    A
    quality
    An MCP server that enables web searching, URL content extraction, and summarization without requiring API keys. It also provides advanced mathematical evaluation and multi-language Wikipedia summary retrieval tools.
    Last updated
    5
    271
    3
    MIT
    • Apple
    • Linux

  • Web Research Assistant

    elad12390
    A
    security
    A
    license
    A
    quality
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    Last updated
    13
    8
    MIT

  • Web Search MCP

    pranavms13
    -
    security
    A
    license
    -
    quality
    Enables web searching through Google, DuckDuckGo, and Bing using a headless Chrome browser, returning structured results with titles, URLs, and snippets. Also supports fetching and extracting text content from any webpage.
    Last updated
    9
    MIT
    • Apple
    • Linux

  • Web Analysis MCP

    himly0302
    A
    security
    F
    license
    B
    quality
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    Last updated
    1

  • perplexity-web-mcp

    quequiere
    A
    security
    A
    license
    A
    quality
    An MCP server that enables AI assistants to perform web searches on Perplexity.ai using browser automation instead of an official API. It supports persistent authenticated sessions and returns search results along with cited sources directly to the client.
    Last updated
    3
    17
    3
    MIT

  • Web Search MCP

    uk0
    -
    security
    A
    license
    -
    quality
    A high-performance search service that converts results from Google, Bing, and DuckDuckGo into structured JSON or Markdown. It features multi-layer depth crawling and uses the Camoufox anti-detection browser for reliable content extraction and fallback search logic.
    Last updated
    39
    MIT

  • Web Search MCP Server

    mrkrsl
    -
    security
    A
    license
    -
    quality
    Enables comprehensive web searching and content extraction using multiple search engines (Bing, Brave, DuckDuckGo) without API keys. Provides tools for full web searches with content extraction, quick search summaries, and single webpage content retrieval.
    Last updated
    774
    MIT

  • MCP Web Docs

    cosmocoder
    -
    security
    A
    license
    -
    quality
    A self-hosted MCP server that crawls, indexes, and searches documentation from any website locally, including private sites requiring authentication. It provides hybrid search capabilities and local embedding generation to maintain privacy while keeping AI assistant knowledge up to date.
    Last updated
    103
    1
    MIT

  • Qontinui Web MCP Server

    qontinui
    -
    security
    A
    license
    -
    quality
    Enables AI assistants to create and manage visual automation configurations, workflows, and UI states through the Qontinui API. It supports project management, workflow execution, and configuration handling for automated web interactions.
    Last updated
    MIT

  • mcp-web-audit

    Shen-zhihao
    A
    security
    F
    license
    B
    quality
    A Node.js-based frontend security audit tool that performs comprehensive dependency security audits for both local projects and remote repositories. Generates detailed Markdown reports with vulnerability detection, risk assessment, and fix recommendations.
    Last updated
    1
    4
    6

  • Web Research MCP Server

    CSOAI-ORG
    -
    security
    A
    license
    -
    quality
    Enables AI agents to perform web searches via DuckDuckGo without API keys and automate browser tasks with headless Chromium. Supports multi-step research workflows that automatically search and extract content from multiple pages.
    Last updated
    MIT

  • Web Development Agent

    shark-bot-0118
    -
    security
    -
    license
    -
    quality
    An MCP server that automatically generates static websites from natural language instructions, creating Next.js-based sites with optional automatic deployment to AWS S3.
    Last updated

  • Enhanced Web Scraper MCP

    JMRMEDEV
    A
    security
    F
    license
    B
    quality
    Enables web scraping, React app testing, and React Native web app inspection using Playwright with multi-browser support. Provides backward compatibility with regular websites while offering enhanced features for React applications including mobile viewport emulation and component analysis.
    Last updated
    10

  • Gemini Google Web Search MCP

    louxsye
    A
    security
    A
    license
    B
    quality
    An MCP server that enables AI models to perform Google Web searches using the Gemini API, complete with citations and grounding metadata for accurate information retrieval. It is compatible with Claude Desktop and other MCP clients for real-time web access.
    Last updated
    1
    1
    Apache 2.0
    • Apple
    • Linux

  • Web Crawler MCP Server

    dhannusch
    -
    security
    F
    license
    -
    quality
    An intelligent web crawling server that uses Cloudflare's headless browser to render dynamic pages and Workers AI to extract relevant links based on natural language queries. It enables AI assistants to search and filter website content while providing secure access through GitHub OAuth authentication.
    Last updated
    3

  • Web Proxy MCP Server

    mako10k
    A
    security
    F
    license
    A
    quality
    Intelligent HTTP/HTTPS proxy server with MCP integration for automated traffic monitoring, analysis, and browser setup.
    Last updated
    22

  • Google OR-Tools server

    Jacck
    -
    security
    A
    license
    -
    quality
    MCP-ORTools integrates Google's OR-Tools constraint programming solver with Large Language Models through the MCP, enabling AI models to: Submit and validate constraint models Set model parameters Solve constraint satisfaction and optimization problems Retrieve and analyze solution
    Last updated
    18
    MIT
    • Apple