Skip to main content
Glama
sharozdawa

robotstxt-ai-mcp

by sharozdawa
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript
Remote

Related Servers

Alternatives to robotstxt-ai-mcp

No user-submitted related servers found.

    Related Servers

    • ai-visibility-mcp

      tsushanth
      A
      license
      A
      quality
      C
      maintenance
      Checks a website's robots.txt and Cloudflare settings to identify AI crawler blocking. Also generates llms.txt content to improve visibility to AI answer engines.
      3
      22
      MIT

    • ai-visibility-mcp

      bestaiinsider
      A
      license
      A
      quality
      D
      maintenance
      Audits AI-bot visibility: robots.txt per-bot for 22 AI user-agents (GPTBot/ClaudeBot/PerplexityBot/etc), Cloudflare flags, JSON-LD, sitemap, llms.txt, SPA shell, plus cross-model brand mentions via Perplexity + OpenRouter. 0-100 score. SSRF-guarded, spend-capped.
      4
      1
      MIT

    • seo-audit-mcp

      cyber-kani
      A
      license
      Not graded
      quality
      C
      maintenance
      Enables AI agents to perform instant SEO audits, check robots.txt, sitemaps, and AI crawler access for any URL without API keys.
      MIT

    • ai-readiness

      silverbackmarketing
      F
      license
      Not graded
      quality
      B
      maintenance
      Generates a complete suite of AI readiness files (llms.txt, ai.txt, schema, RAG indexes) for any website to optimize representation in ChatGPT, Claude, Gemini, and Perplexity.
      3
      -
    • llmstxtgenerator-mcp by llms-txt-generator

      llmstxtgenerator-mcpofficial

      llms-txt-generator
      A
      license
      Not graded
      quality
      C
      maintenance
      Enables AI agents to create, validate, and audit llms.txt files for websites, including checking against Google Lighthouse's Agentic Browsing requirements, via Streamable HTTP with no API key needed.
      8
      2
      MIT
    Deploy Server
    RayrunBuild, deploy, and operate MCP servers without becoming an infrastructure team.ray.runAd

    TDQS

    A4/5.0

    Scored across 5 tools

    Disambiguation5/5

    Each tool targets a distinct operation: analyzing pasted content, checking a specific bot, fetching from a URL, generating, and listing bots. No overlap in functionality.

    Naming Consistency5/5

    All tool names follow a consistent verb_noun pattern with snake_case (e.g., analyze_robots, check_bot_status). No mixing of conventions.

    Tool Count5/5

    Five tools is a well-scoped set for this domain, covering the essential tasks without being too few or excessive.

    Completeness5/5

    The tools cover the full lifecycle: fetching, analyzing, checking specific bots, generating, and listing known AI bots. No obvious gaps for the intended purpose.

    Maintenance

    ActivityInactive
    ResponsivenessNo issues

    Resources