Skip to main content
Glama
72,746 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • mcp-web-tools

    paifas
    A
    license
    A
    quality
    B
    maintenance
    Provides web search and content extraction tools for AI assistants, with zero configuration and swappable backends.
    6
    29
    1
    MIT

  • web-doctor

    Baneado98
    A
    license
    A
    quality
    B
    maintenance
    Enables live website health checks including TLS, HTTPS, and security headers, returning an A-F grade with specific fixes.
    2
    MIT

  • Web Reader

    zacfire
    A
    license
    A
    quality
    D
    maintenance
    Enables Claude and other LLMs to read and parse web content, with smart fallback strategies to bypass access restrictions (e.g., paywalls, Cloudflare) and output Markdown.
    5
    18
    44
    MIT

  • mcp-web-calc

    tickernelz
    A
    license
    A
    quality
    D
    maintenance
    An MCP server that enables web searching, URL content extraction, and summarization without requiring API keys. It also provides advanced mathematical evaluation and multi-language Wikipedia summary retrieval tools.
    5
    327
    6
    MIT

  • web-basics-mcp

    yoloyash
    A
    license
    B
    quality
    B
    maintenance
    A self-hosted MCP server providing web search and URL fetching tools, running locally without external API keys or accounts.
    2
    MIT

  • Web Analysis MCP

    himly0302
    F
    license
    B
    quality
    F
    maintenance
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    1

  • MCP Web Scrape

    mukul975
    A
    license
    B
    quality
    D
    maintenance
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    48
    23
    36
    MIT

  • web-mcp

    sv-kagami
    F
    license
    B
    quality
    C
    maintenance
    Provides web search and page fetch tools for LLM assistants, extracting content and enabling text search within fetched pages.
    3
  • Agent Tools by AtmaticAI

    Agent Toolsofficial

    AtmaticAI
    A
    license
    -
    quality
    C
    maintenance
    Provides deterministic tools for transforming, formatting, and inspecting structured data for AI agents.
    15
    19
    Apache 2.0

  • web-search

    Br0ski777
    A
    license
    -
    quality
    B
    maintenance
    Web search API for AI agents. Returns structured results with title, URL, and snippet; pay-per-call via x402 micropayments.
    MIT

  • Vercel MCP Web Crawler

    AIEterprise
    A
    license
    -
    quality
    C
    maintenance
    Provides lightweight web crawling and scraping capabilities, enabling users to fetch pages as clean Markdown, recursively crawl domains, extract metadata, and perform search-and-crawl operations.
    6
    MIT

  • MCP Tools

    joehuangcoding
    A
    license
    -
    quality
    D
    maintenance
    A local Model Context Protocol (MCP) server that exposes custom tools to Claude Desktop, enabling direct interaction with your local environment. It provides a framework for building and integrating custom TypeScript tools into the Claude interface.
    11
    MIT

  • DDG Web Search

    luciVuc
    A
    license
    -
    quality
    D
    maintenance
    Enables web search via DuckDuckGo and web content fetching through the Model Context Protocol, allowing AI assistants to search and retrieve web page content.
    15
    MIT

  • mcp-web

    TsFreddie
    A
    license
    -
    quality
    F
    maintenance
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    7
    MIT

  • Web-MCP

    mike-nott
    A
    license
    -
    quality
    B
    maintenance
    Provides MCP tools to search and read social discussions from Reddit and X, and fetch pages blocked by bot protection, using a private Cloudflare Worker.
    MIT