Skip to main content
Glama
sharozdawa

robotstxt-ai-mcp

by sharozdawa
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript
Remote

Related Servers

Alternatives to robotstxt-ai-mcp

No user-submitted related servers found.

    Related Servers

    • ai-visibility-mcp

      tsushanth
      A
      license
      A
      quality
      C
      maintenance
      Checks a website's robots.txt and Cloudflare settings to identify AI crawler blocking. Also generates llms.txt content to improve visibility to AI answer engines.
      3
      49 npm
      MIT

    • ai-visibility-mcp

      bestaiinsider
      A
      license
      A
      quality
      D
      maintenance
      Audits AI-bot visibility: robots.txt per-bot for 22 AI user-agents (GPTBot/ClaudeBot/PerplexityBot/etc), Cloudflare flags, JSON-LD, sitemap, llms.txt, SPA shell, plus cross-model brand mentions via Perplexity + OpenRouter. 0-100 score. SSRF-guarded, spend-capped.
      4
      1
      MIT

    • seo-audit-mcp

      cyber-kani
      A
      license
      Not graded
      quality
      D
      maintenance
      Enables AI agents to perform instant SEO audits, check robots.txt, sitemaps, and AI crawler access for any URL without API keys.
      MIT

    • ai-readiness

      silverbackmarketing
      F
      license
      Not graded
      quality
      D
      maintenance
      Generates a complete suite of AI readiness files (llms.txt, ai.txt, schema, RAG indexes) for any website to optimize representation in ChatGPT, Claude, Gemini, and Perplexity.
      3
      -

    • Crawl Readiness MCP Server

      Grubbomatic
      A
      license
      A
      quality
      A
      maintenance
      Enables AI assistants to run live SEO/readiness audits against 50+ AI crawlers, validate schema and robots.txt, and generate llms.txt, robots.txt, and JSON-LD files directly from MCP-compatible clients like Claude Desktop and Cursor.
      8
      138 npm
      MIT
    • llmstxtgenerator-mcp by llms-txt-generator

      llmstxtgenerator-mcpofficial

      llms-txt-generator
      A
      license
      Not graded
      quality
      C
      maintenance
      Enables AI agents to create, validate, and audit llms.txt files for websites, including checking against Google Lighthouse's Agentic Browsing requirements, via Streamable HTTP with no API key needed.
      11 npm
      2
      MIT
    Deploy Server
    One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

    TDQS

    A4/5.0

    Scored across 5 tools

    Disambiguation5/5

    Each tool targets a distinct operation: analyzing pasted content, checking a specific bot, fetching from a URL, generating, and listing bots. No overlap in functionality.

    Naming Consistency5/5

    All tool names follow a consistent verb_noun pattern with snake_case (e.g., analyze_robots, check_bot_status). No mixing of conventions.

    Tool Count5/5

    Five tools is a well-scoped set for this domain, covering the essential tasks without being too few or excessive.

    Completeness5/5

    The tools cover the full lifecycle: fetching, analyzing, checking specific bots, generating, and listing known AI bots. No obvious gaps for the intended purpose.

    Maintenance

    ActivityInactive
    ResponsivenessNo issues

    Resources