Skip to main content
Glama
72,746 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • web-scout

    SanZiNEO
    A
    license
    B
    quality
    B
    maintenance
    A reconnaissance MCP server that discovers web data sources by monitoring network requests and extracting API structures, enabling AI to understand data location and format without full crawling.
    21
    2
    MIT

  • web-search-mcp

    victormacaubas
    F
    license
    A
    quality
    B
    maintenance
    A local MCP server that gives Claude Code web search capabilities using DuckDuckGo, enabling discovery of URLs from natural language queries.
    1
    1
  • redup.mcp-web-parser by redup-ai

    redup.mcp-web-parserofficial

    redup-ai
    A
    license
    A
    quality
    B
    maintenance
    MCP server that parses web pages into clean markdown via Crawl4AI's HTTP API, exposing parse_page and health-check tools with configurable proxy and timeout.
    2
    MIT

  • Ollama Web Search

    deXterbed
    A
    license
    A
    quality
    A
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    MIT

  • web-slack-mcp

    sercant
    A
    license
    A
    quality
    C
    maintenance
    Enables reading Slack channels, messages, and threads using the web interface via a persistent browser session, designed for guest users without API access. Does not send messages.
    5
    MIT

  • Web Search MCP

    sydasif
    A
    license
    A
    quality
    B
    maintenance
    Provides LLMs with real-time web search and content extraction capabilities, including text/news search, full-text URL reading, and targeted technical documentation search.
    3
    18
    MIT
  • Open and Async MCP Server by open-and-async

    Open and Async MCP Serverofficial

    open-and-async
    A
    license
    A
    quality
    A
    maintenance
    Enables async-first working practices by providing tools to draft decision docs, convert meetings to async artifacts, score status updates, and triage sync vs async tasks. It also offers reference tools for the Open and Async book's principles and coaching prompts.
    11
    122
    45
    Inno Setup

  • web-fetch-mcp

    bpzx
    A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT

  • cute-web-scraper

    maccydee
    A
    license
    A
    quality
    B
    maintenance
    MCP server for web scraping with natural language, enabling site crawling, page fetching, and extraction of emails, phones, links, and social profiles. Returns clean markdown, handles JavaScript rendering, and respects rate limits.
    8
    MIT

  • recipe-tools

    lka
    A
    license
    A
    quality
    A
    maintenance
    Enables extraction of recipes from PDFs or JPG files and conversion into structured HTML, with interactive region selection and OCR via a web GUI.
    6
    MIT

  • mcp-web-search

    nacho4d
    A
    license
    A
    quality
    C
    maintenance
    Provides DuckDuckGo web search and site fetching tools for Claude Desktop, enabling up to 10 search results and text content extraction from URLs.
    2
    MIT

  • web-archive-mcp

    jmars
    F
    license
    A
    quality
    B
    maintenance
    Persists web fetch and search results as timestamped JSONL files, indexed for full-text search, enabling users to retrieve and search across archived web pages even after they are removed or changed.
    17

  • web-search-mcp

    bartdorlandt
    F
    license
    A
    quality
    B
    maintenance
    Provides a web search tool with citations by running Claude Code CLI in an isolated Docker container, enabling search even in environments without direct Anthropic web search support.
    1

  • Web Research Assistant

    elad12390
    A
    license
    A
    quality
    A
    maintenance
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    14
    9
    MIT