Skip to main content
Glama
72,644 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • mcp-web-tools

    paifas
    A
    license
    A
    quality
    B
    maintenance
    Provides web search and content extraction tools for AI assistants, with zero configuration and swappable backends.
    6
    29
    1
    MIT

  • MCP Web Tools

    SayreBlades
    F
    license
    A
    quality
    D
    maintenance
    Provides local web search and content fetching capabilities for AI assistants, enabling them to search DuckDuckGo and extract clean text from web pages. All requests originate from the user's machine to ensure direct network control and bypass external proxies.
    2

  • web-scout

    SanZiNEO
    A
    license
    B
    quality
    B
    maintenance
    A reconnaissance MCP server that discovers web data sources by monitoring network requests and extracting API structures, enabling AI to understand data location and format without full crawling.
    21
    2
    MIT

  • Python Crawling MCP

    BaektotheFuture98
    F
    license
    -
    quality
    B
    maintenance
    An MCP server for safe web crawling and scraping of public and authenticated sites using Playwright and Crawlee. It provides tools for scraping single pages, crawling entire sites, validating sessions, and listing supported sites, with built-in security protections and adapter-based extensibility.

  • Ollama Web Search

    deXterbed
    A
    license
    A
    quality
    A
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    MIT

  • cute-web-scraper

    maccydee
    A
    license
    A
    quality
    B
    maintenance
    MCP server for web scraping with natural language, enabling site crawling, page fetching, and extraction of emails, phones, links, and social profiles. Returns clean markdown, handles JavaScript rendering, and respects rate limits.
    8
    MIT

  • recipe-tools

    lka
    A
    license
    A
    quality
    A
    maintenance
    Enables extraction of recipes from PDFs or JPG files and conversion into structured HTML, with interactive region selection and OCR via a web GUI.
    6
    MIT

  • web-doctor

    Baneado98
    A
    license
    A
    quality
    B
    maintenance
    Enables live website health checks including TLS, HTTPS, and security headers, returning an A-F grade with specific fixes.
    2
    MIT

  • Web Content Extractor MCP

    agenson-tools
    A
    license
    A
    quality
    C
    maintenance
    Enables AI agents to extract clean, structured web content (articles, tables, links, visual layouts) optimized for LLM token efficiency, with fast response times and optional JavaScript support.
    5
    81
    MIT

  • Web Reader

    zacfire
    A
    license
    A
    quality
    D
    maintenance
    Enables Claude and other LLMs to read and parse web content, with smart fallback strategies to bypass access restrictions (e.g., paywalls, Cloudflare) and output Markdown.
    5
    18
    44
    MIT

  • web-search-mcp

    hbhszy
    A
    license
    A
    quality
    C
    maintenance
    Enables real-time web search via DeepSeek's search-enhanced dialogue, providing search results as answers through MCP tools.
    1
    MIT

  • Web Research Assistant

    elad12390
    A
    license
    A
    quality
    A
    maintenance
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    14
    9
    MIT

  • Hive Web

    YegorMy
    A
    license
    B
    quality
    B
    maintenance
    A local MCP server providing web search, page extraction, and safe browser automation tools for Hermes, Claude Code, and other MCP clients.
    10
    MIT

  • Web Analysis MCP

    himly0302
    F
    license
    B
    quality
    F
    maintenance
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    1

  • web-mcp

    sv-kagami
    F
    license
    B
    quality
    C
    maintenance
    Provides web search and page fetch tools for LLM assistants, extracting content and enabling text search within fetched pages.
    3