Skip to main content
Glama
37,270 servers. Last updated

Matching MCP tools:

Matching MCP Connectors:

"Web crawling techniques and tools" matching MCP servers:

  • F
    license
    A
    quality
    D
    maintenance
    Provides local web search and content fetching capabilities for AI assistants, enabling them to search DuckDuckGo and extract clean text from web pages. All requests originate from the user's machine to ensure direct network control and bypass external proxies.
    Last updated
    2
  • A
    license
    A
    quality
    B
    maintenance
    Enables web search and web fetch operations using Ollama's hosted APIs, allowing MCP clients to search the web and retrieve page content.
    Last updated
    2
    MIT
  • A
    license
    A
    quality
    F
    maintenance
    Enables Claude and other LLMs to read and parse web content, with smart fallback strategies to bypass access restrictions (e.g., paywalls, Cloudflare) and output Markdown.
    Last updated
    5
    49
    43
    MIT
  • A
    license
    A
    quality
    C
    maintenance
    An MCP server that enables web searching, URL content extraction, and summarization without requiring API keys. It also provides advanced mathematical evaluation and multi-language Wikipedia summary retrieval tools.
    Last updated
    5
    388
    6
    MIT
  • F
    license
    A
    quality
    B
    maintenance
    Enables token-efficient web reading and HTTP requests for MCP agents, with tools for extracting clean text from web pages and making full HTTP requests.
    Last updated
    2
  • A
    license
    A
    quality
    B
    maintenance
    Comprehensive web research toolkit with 13 tools for searching (via SearXNG), crawling, package discovery, GitHub metrics, error translation, API documentation lookup, data extraction, technology comparison, and service status checking.
    Last updated
    14
    9
    MIT
  • A
    license
    A
    quality
    B
    maintenance
    Enables real-time web search via DeepSeek's search-enhanced dialogue, providing search results as answers through MCP tools.
    Last updated
    1
    MIT
  • F
    license
    B
    quality
    D
    maintenance
    Enables intelligent web searching using SearXNG with content crawling via Creeper, then summarizes webpage content using LLM to avoid token limit issues. Supports smart filtering with domain blacklist/whitelist and optional LLM-based relevance filtering.
    Last updated
    1
  • A
    license
    B
    quality
    D
    maintenance
    A comprehensive web scraping server that transforms web content into clean, agent-ready Markdown with automatic citations and efficient caching. It features a robust suite of tools for metadata extraction, sentiment analysis, SEO auditing, and security scanning while strictly adhering to robots.txt policies.
    Last updated
    48
    16
    18
    MIT
  • A
    license
    C
    quality
    D
    maintenance
    Enables access to Usage and Billing APIs for managing accounts, products, meters, plans, and usage reporting. Supports operations like creating products/plans, reporting usage, and retrieving billing information.
    Last updated
    18
    MIT
  • A
    license
    -
    quality
    C
    maintenance
    A high-performance search service that converts results from Google, Bing, and DuckDuckGo into structured JSON or Markdown. It features multi-layer depth crawling and uses the Camoufox anti-detection browser for reliable content extraction and fallback search logic.
    Last updated
    55
    MIT
  • A
    license
    -
    quality
    D
    maintenance
    A collection of simple, practical MCP servers that require zero configuration, enabling web search via DuckDuckGo (no API key needed) and management of Hexo blogs through AI.
    Last updated
    MIT
  • A
    license
    -
    quality
    F
    maintenance
    Enables AI agents to search DuckDuckGo and fetch web content with human-assisted CAPTCHA handling, designed for local use where humans can intervene when bot detection occurs.
    Last updated
    7
    MIT
  • A
    license
    -
    quality
    C
    maintenance
    Enables web search using Bing and DuckDuckGo combined, and fetching readable content from web pages, with no API key required.
    Last updated
    9
    MIT
  • A
    license
    -
    quality
    F
    maintenance
    📇 ☁️ - Capture web pages as cryptographically signed, tamper-evident evidence. Ed25519 signatures, RFC 3161 timestamps, and WACZ archives. Four tools: capture_url, get_capture, list_captures, verify_capture.
    Last updated
    3
    1
    MIT