Skip to main content
Glama
coolaigit

site-crawler-mcp

by coolaigit
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Local

Related Servers

Alternatives to site-crawler-mcp

No user-submitted related servers found.

    Related Servers

    • MCP Web Research Agent

      SnotacusNexus
      A
      license
      Not graded
      quality
      D
      maintenance
      Enables automated web research and intelligence gathering through recursive web crawling, multi-engine search integration, and persistent SQLite storage with support for keyword filtering and multiple export formats.
      MIT

    • icecrawl MCP server

      MrGreenlaw
      F
      license
      Not graded
      quality
      C
      maintenance
      Enables scraping single pages or crawling entire websites, converting content to markdown and optionally extracting structured data with Claude.
      -

    • SEO Crawler MCP

      houtini-ai
      A
      license
      A
      quality
      F
      maintenance
      A comprehensive website crawler and SEO analyzer that stores site data in a local SQLite database for AI-driven auditing. It enables users to detect technical SEO issues, broken links, and security vulnerabilities through natural language queries or terminal commands.
      4
      37 npm
      16
      Apache 2.0
    • Open Crawler MCP Server by elchika-inc

      Open Crawler MCP Serverofficial

      elchika-inc
      A
      license
      Not graded
      quality
      C
      maintenance
      Enables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
      14 npm
      1
      MIT

    • Spider MCP Server

      oeo
      F
      license
      Not graded
      quality
      D
      maintenance
      Enables crawling and extracting clean content from documentation websites with optional LLM-powered analysis for intelligent summaries, code example extraction, and content classification.
      -

    • mcp-page-monitor

      deialedin
      A
      license
      A
      quality
      D
      maintenance
      Enables monitoring web pages for changes using Playwright, storing snapshots in SQLite, and optionally analyzing changes with an LLM for business impact assessment.
      5
      MIT
    Deploy Server
    Give agents eyes on the webHosted screenshot MCP. Send a URL, get a pixel-perfect image. $0.002 per grab. Works with Claude, Cursor, and Codex.grabbit.liveAd

    TDQS

    A3.5/5.0

    Scored across 6 tools

    Disambiguation5/5

    Each tool has a clearly distinct purpose: full site crawling, single page scraping, summarization, link clicking, file downloading, and querying. No overlap or ambiguity.

    Naming Consistency5/5

    All tools follow a consistent verb_noun pattern in snake_case (e.g., crawl_site, scrape_page, query_crawls), making the tool set predictable and easy to navigate.

    Tool Count5/5

    With 6 tools, the server is well-scoped. It covers the essential operations for a site crawler without unnecessary bloat or missing functionality.

    Completeness4/5

    The tool set covers core workflows: crawling, scraping, summarizing, interacting, downloading, and querying. Minor gaps like explicit crawl session management or update/delete operations exist, but the surface is largely complete for typical use cases.

    Maintenance

    ActivitySlowing
    ResponsivenessNo issues

    Resources