Skip to main content
Glama
coolaigit

site-crawler-mcp

by coolaigit

Related Servers

Alternatives to site-crawler-mcp

No user-submitted related servers found.

    Related Servers

    • A
      license
      -
      quality
      D
      maintenance
      Enables automated web research and intelligence gathering through recursive web crawling, multi-engine search integration, and persistent SQLite storage with support for keyword filtering and multiple export formats.
      MIT
    • F
      license
      -
      quality
      C
      maintenance
      Enables scraping single pages or crawling entire websites, converting content to markdown and optionally extracting structured data with Claude.
    • A
      license
      A
      quality
      F
      maintenance
      A comprehensive website crawler and SEO analyzer that stores site data in a local SQLite database for AI-driven auditing. It enables users to detect technical SEO issues, broken links, and security vulnerabilities through natural language queries or terminal commands.
      4
      54
      16
      Apache 2.0
    • A
      license
      -
      quality
      C
      maintenance
      Enables web crawling and content extraction from web pages, supporting multiple output formats like text, markdown, XML, and JSON, with robots.txt compliance and rate limiting.
      14
      1
      MIT
    • A
      license
      A
      quality
      D
      maintenance
      Enables monitoring web pages for changes using Playwright, storing snapshots in SQLite, and optionally analyzing changes with an LLM for business impact assessment.
      5
      MIT

    Latest Blog Posts

    MCP directory API

    We provide all the information about MCP servers via our MCP API.

    curl -X GET 'https://glama.ai/api/mcp/v1/servers/coolaigit/site-crawler-mcp'

    If you have feedback or need assistance with the MCP directory API, please join our Discord server