Skip to main content
Glama
72,746 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • MCP Web Tools

    SayreBlades
    F
    license
    A
    quality
    D
    maintenance
    Provides local web search and content fetching capabilities for AI assistants, enabling them to search DuckDuckGo and extract clean text from web pages. All requests originate from the user's machine to ensure direct network control and bypass external proxies.
    2

  • web-scout

    SanZiNEO
    A
    license
    B
    quality
    B
    maintenance
    A reconnaissance MCP server that discovers web data sources by monitoring network requests and extracting API structures, enabling AI to understand data location and format without full crawling.
    21
    2
    MIT

  • Python Crawling MCP

    BaektotheFuture98
    F
    license
    -
    quality
    B
    maintenance
    An MCP server for safe web crawling and scraping of public and authenticated sites using Playwright and Crawlee. It provides tools for scraping single pages, crawling entire sites, validating sessions, and listing supported sites, with built-in security protections and adapter-based extensibility.

  • whed-tools

    Dasistaiden
    F
    license
    -
    quality
    D
    maintenance
    An MCP-native pipeline for collecting structured intelligence on higher education institutions using the WHED schema, enabling scraping, extraction, validation, and saving of profiles.

  • Ollama Web Search

    deXterbed
    A
    license
    A
    quality
    A
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    2
    MIT

  • web-fetch-mcp

    bpzx
    A
    license
    A
    quality
    C
    maintenance
    MCP server for web page fetching (converting to Markdown/text with automatic fallback between Tavily and Firecrawl) and web search via Tavily.
    2
    MIT

  • mcp-tools

    egnaro9
    A
    license
    A
    quality
    B
    maintenance
    Provides five safe tools (calc, search, model_drift, compare_runs, grade_answer) for arithmetic, keyword search, model drift monitoring, eval comparison, and answer grading against sources, all implemented directly from the MCP spec with zero dependencies.
    5
    MIT

  • cute-web-scraper

    maccydee
    A
    license
    A
    quality
    B
    maintenance
    MCP server for web scraping with natural language, enabling site crawling, page fetching, and extraction of emails, phones, links, and social profiles. Returns clean markdown, handles JavaScript rendering, and respects rate limits.
    8
    MIT

  • recipe-tools

    lka
    A
    license
    A
    quality
    A
    maintenance
    Enables extraction of recipes from PDFs or JPG files and conversion into structured HTML, with interactive region selection and OCR via a web GUI.
    6
    MIT

  • Web Check MCP

    ameobius-ai
    A
    license
    A
    quality
    B
    maintenance
    MCP server that exposes 31 OSINT checks from Lissy93/web-check as tools for website analysis, including SSL, DNS, headers, WHOIS, and security presets. Enables natural-language-driven web recon and health checks.
    8
    MIT

  • mcp-web-search

    nacho4d
    A
    license
    A
    quality
    C
    maintenance
    Provides DuckDuckGo web search and site fetching tools for Claude Desktop, enabling up to 10 search results and text content extraction from URLs.
    2
    MIT

  • web-archive-mcp

    jmars
    F
    license
    A
    quality
    B
    maintenance
    Persists web fetch and search results as timestamped JSONL files, indexed for full-text search, enabling users to retrieve and search across archived web pages even after they are removed or changed.
    17

  • web-search-mcp

    bartdorlandt
    F
    license
    A
    quality
    B
    maintenance
    Provides a web search tool with citations by running Claude Code CLI in an isolated Docker container, enabling search even in environments without direct Anthropic web search support.
    1