Skip to main content
Glama
72,775 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • cute-web-scraper

    maccydee
    A
    license
    A
    quality
    B
    maintenance
    MCP server for web scraping with natural language, enabling site crawling, page fetching, and extraction of emails, phones, links, and social profiles. Returns clean markdown, handles JavaScript rendering, and respects rate limits.
    8
    MIT

  • web-doctor

    Baneado98
    A
    license
    A
    quality
    B
    maintenance
    Enables live website health checks including TLS, HTTPS, and security headers, returning an A-F grade with specific fixes.
    2
    MIT

  • Web Content Extractor MCP

    agenson-tools
    A
    license
    A
    quality
    C
    maintenance
    Enables AI agents to extract clean, structured web content (articles, tables, links, visual layouts) optimized for LLM token efficiency, with fast response times and optional JavaScript support.
    5
    81
    MIT

  • Web Analysis MCP

    himly0302
    F
    license
    B
    quality
    F
    maintenance
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    1
  • Agent Tools by AtmaticAI

    Agent Toolsofficial

    AtmaticAI
    A
    license
    -
    quality
    C
    maintenance
    Provides deterministic tools for transforming, formatting, and inspecting structured data for AI agents.
    15
    19
    Apache 2.0

  • web-mcp

    Chang-Tong
    A
    license
    -
    quality
    B
    maintenance
    MCP server for multi-engine web search and web page fetching, supporting parallel search, content extraction, and optional LLM-powered search summarization and deep search.
    2
    MIT

  • DDG Web Search

    luciVuc
    A
    license
    -
    quality
    D
    maintenance
    Enables web search via DuckDuckGo and web content fetching through the Model Context Protocol, allowing AI assistants to search and retrieve web page content.
    15
    MIT

  • gemini-web-mcp

    edwyn211
    A
    license
    -
    quality
    B
    maintenance
    An MCP server for automated interaction with Gemini's web interface using Playwright and LangGraph, enabling task execution, deep research, file uploads, chat management, and dynamic selector verification via MCP tools.
    1
    MIT

  • Web Search MCP

    uk0
    A
    license
    -
    quality
    B
    maintenance
    A high-performance search service that converts results from Google, Bing, and DuckDuckGo into structured JSON or Markdown. It features multi-layer depth crawling and uses the Camoufox anti-detection browser for reliable content extraction and fallback search logic.
    64
    MIT

  • Graph-Tools

    dromologue
    F
    license
    -
    quality
    D
    maintenance
    Provides tools for AI-powered graph analysis, including relationship extraction, adjacency matrix creation, and network centrality calculations. It enables users to perform complex structural analysis and generate interactive D3.js visualizations from structured data.

  • MCP Tools

    dlightyupgrade
    F
    license
    -
    quality
    C
    maintenance
    A modular multi-server architecture providing development automation, JIRA management, and performance reporting for Claude Code. It features specialized tools for PR health analysis, code reviews, and generating comprehensive team and individual quarterly reports.

  • web-search-mcp

    remon-rakibul
    F
    license
    -
    quality
    C
    maintenance
    Provides a free web search tool to MCP clients by connecting to a self-hosted SearXNG metasearch instance, enabling users to search the web with customizable parameters like categories and time range.

  • seo-tools-mcp

    antohins
    A
    license
    A
    quality
    B
    maintenance
    Five general-purpose stdio MCP servers for SEO: access to SERP, Wordstat, Google Search Console, Yandex.Webmaster and Yandex.Metrica straight from Claude Code (or any MCP client). All tools are read-only, output is strict JSON. Not tied to a specific site: defaults (GSC property, Webmaster host, Metrica counter) are configured on the fly.
    2
    11
    2
    MIT

  • gemini-web-mcp

    TakashiAihara
    A
    license
    A
    quality
    F
    maintenance
    MCP server for querying Google Gemini Web from Claude Code and other MCP clients, using cookie-based authentication. Enables creating, continuing, listing, viewing, and deleting Gemini chat conversations with model and thinking mode control.
    6
    AGPL 3.0

  • Utilia Agent Media and Solana

    mohamedkuch
    A
    license
    A
    quality
    B
    maintenance
    Wallet-funded MCP client for six paid Utilia tools: Solana priority fees, transaction diagnosis and simulation, token-risk checks, PDF-to-Markdown, and audio normalization over x402. MIT-licensed and installable from npm.
    6
    115
    MIT