Skip to main content
Glama
76,650 servers. Updated

Matching MCP tools:

Matching MCP Connectors:

"Understanding Web Crawlers" matching MCP servers:

  • A
    license
    A
    quality
    A
    maintenance
    MCP server for AI-powered web research — search (Google, Brave, Serper, SearXNG), scrape any page, extract PDFs/DOCX/YouTube transcripts, academic & patent search. Single Go binary. Works with Claude, Cursor, Copilot, and any MCP client.
    25
    52
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    A fault-tolerant, stealth-enabled Model Context Protocol (MCP) server for web searching and content fetching. Built for AI Agents (Cursor, Claude Code, OpenCode), it uses a stealth browser engine to fetch pages, dynamically handles SPAs/React, and converts bloat into token-optimized Markdown.
    2
    319
    2
    MIT
  • A
    license
    C
    quality
    A
    maintenance
    Enables AI agents to perform web searches via DuckDuckGo without API keys and automate browser tasks with headless Chromium. Supports multi-step research workflows that automatically search and extract content from multiple pages.
    7
    28
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Self-contained SearXNG MCP server in Docker. Aggregates 200+ search engines across 30+ categories with multi-page fanout, autocomplete, and engine discovery. Dual transport (HTTP + stdio), API key auth, and built-in Web UI reverse proxy.
    6
    3
    10
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Free self-hosted web search for AI agents with multi-engine parallel search, semantic re-ranking, and native China network support. Zero API keys.
    2
    27
    MIT
  • A
    license
    A
    quality
    D
    maintenance
    Provides privacy-focused web search capabilities through SearXNG metasearch engine, enabling web, image, video, and news searches without tracking. Includes comprehensive research tools that aggregate and analyze results from multiple search engines.
    3
    4
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Enables natural language queries of the Chrome UX Report API to fetch Core Web Vitals (LCP, INP, CLS, FCP, TTFB), compare form factors, benchmark pages against site averages, and analyze up to 40 weeks of performance trends.
    6
    134
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Enables AI agents to convert files, render web pages to markdown/PDF/screenshots, search the live web, extract structured data, ingest RAG-ready chunks, and monitor pages for changes through a single API key.
    20
    24
    720
    7
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Pay-per-use clean web reader for AI agents. URL in, markdown plus metadata out, in milliseconds. Settled per-call in USDC over x402 — no signup, no API keys.
    2
    1
    85
    2
    MIT
  • A
    license
    A
    quality
    A
    maintenance
    Provides MCP tools for web scraping, including smart fetching, proxy rotation, and browser rendering to bypass anti-bot challenges and render JavaScript-heavy sites.
    4
    320
    4
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    A domain security and privacy checker MCP server that runs locally, performing DNS, TLS, HTTP, and RDAP lookups to generate a scored report covering certificates, email authentication, DNS, and web security headers.
    2
    3
    81
    GPL 3.0
  • A
    license
    A
    quality
    B
    maintenance
    MCP server for the CortexCloud API, enabling pay-per-call AI generation, web search, market data, and blockchain RPC endpoints via the x402 protocol, billed in USDC on Base without API keys or subscriptions.
    4
    20
    MIT