Skip to main content
Glama
72,746 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • web-scout

    SanZiNEO
    A
    license
    B
    quality
    B
    maintenance
    A reconnaissance MCP server that discovers web data sources by monitoring network requests and extracting API structures, enabling AI to understand data location and format without full crawling.
    21
    2
    MIT

  • web-search-mcp

    victormacaubas
    F
    license
    A
    quality
    B
    maintenance
    A local MCP server that gives Claude Code web search capabilities using DuckDuckGo, enabling discovery of URLs from natural language queries.
    1
    1
  • redup.mcp-web-parser by redup-ai

    redup.mcp-web-parserofficial

    redup-ai
    A
    license
    A
    quality
    B
    maintenance
    MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.
    2
    MIT

  • Ollama Web Search

    deXterbed
    A
    license
    A
    quality
    A
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    MIT

  • web-fetch-mcp

    bpzx
    A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT

  • cute-web-scraper

    maccydee
    A
    license
    A
    quality
    B
    maintenance
    MCP server for web scraping with natural language, enabling site crawling, page fetching, and extraction of emails, phones, links, and social profiles. Returns clean markdown, handles JavaScript rendering, and respects rate limits.
    8
    MIT

  • material-web-mcp

    shantoislamdev
    A
    license
    A
    quality
    C
    maintenance
    Provides programmatic access to Material Web documentation and components for AI agents, enabling documentation search, template generation, and HTML validation.
    7
    16
    1
    MIT

  • recipe-tools

    lka
    A
    license
    A
    quality
    A
    maintenance
    Enables extraction of recipes from PDFs or JPG files and conversion into structured HTML, with interactive region selection and OCR via a web GUI.
    6
    MIT

  • mcp-web-search

    nacho4d
    A
    license
    A
    quality
    C
    maintenance
    Provides DuckDuckGo web search and site fetching tools for Claude Desktop, enabling up to 10 search results and text content extraction from URLs.
    2
    MIT

  • web-archive-mcp

    jmars
    F
    license
    A
    quality
    B
    maintenance
    Persists web fetch and search results as timestamped JSONL files, indexed for full-text search, enabling users to retrieve and search across archived web pages even after they are removed or changed.
    17

  • web-search-mcp

    bartdorlandt
    F
    license
    A
    quality
    B
    maintenance
    Provides a web search tool with citations by running Claude Code CLI in an isolated Docker container, enabling search even in environments without direct Anthropic web search support.
    1

  • Web Research Assistant

    elad12390
    A
    license
    A
    quality
    A
    maintenance
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    14
    9
    MIT

  • Hive Web

    YegorMy
    A
    license
    B
    quality
    B
    maintenance
    A local MCP server providing web search, page extraction, and safe browser automation tools for Hermes, Claude Code, and other MCP clients.
    10
    MIT

  • MCP Web Scrape

    mukul975
    A
    license
    B
    quality
    D
    maintenance
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    48
    23
    36
    MIT