Skip to main content
Glama
nikolaymokh-dev

common-crawl-mcp

Related Servers

Alternatives to common-crawl-mcp

No user-submitted related servers found.

    Related Servers

    • F
      license
      A
      quality
      D
      maintenance
      MCP server for Common Crawl CDX that enables backlink discovery, expired domain finding, and competitor gap analysis without requiring API keys.
      4
    • A
      license
      A
      quality
      A
      maintenance
      MCP server and CLI tool for interacting with the Internet Archive's Wayback Machine, supporting full CDX search, snapshot retrieval, screenshot listing, snapshot comparison, and optional authentication.
      8
      758
      44
      Creative Commons Attribution Non Commercial Share Alike 4.0 International
    • A
      license
      A
      quality
      B
      maintenance
      MCP server for the Internet Archive's Wayback Machine. Search archived snapshots, extract page text from a specific date, track how a site has changed over time, check if broken links are recoverable, and perform research across Internet Archive collections.
      6
      3
      MIT
    • F
      license
      Not graded
      quality
      C
      maintenance
      Bridge the gap between your web crawl and AI language models. With mcp-server-webcrawl, your AI client filters and analyzes web content under your direction or autonomously, extracting insights from your web content. Supports WARC, wget, InterroBot, Katana, and SiteOne crawlers.
      45
      Python
    • A
      license
      Not graded
      quality
      A
      maintenance
      MCP server for AI search crawler governance, brand safety, and search infrastructure auditing. Provides tools to audit robots.txt, canonical links, sitemaps, redirects, and send IndexNow notifications.
      MIT
    • A
      license
      A
      quality
      B
      maintenance
      MCP server for the CrawlGraph backlink-intelligence API. Gives any MCP client - Claude Desktop, Claude Code, Cursor, Cline, Zed, Windsurf - backlink lookups and competitor gap analysis built on the public Common Crawl webgraph (4.4B edges, 120M domains).
      4
      180
      3
      MIT

    Latest Blog Posts

    MCP directory API

    We provide all the information about MCP servers via our MCP API.

    curl -X GET 'https://glama.ai/api/mcp/v1/servers/nikolaymokh-dev/common-crawl-mcp'

    If you have feedback or need assistance with the MCP directory API, please join our Discord server