Skip to main content
Glama
sharozdawa

robotstxt-ai-mcp

by sharozdawa
OverviewSchemaSourceRelated ServersDiscussionsAdmin
TypeScript
Remote

Related Servers

Alternatives to robotstxt-ai-mcp

No user-submitted related servers found.

    Related Servers

    • OpenGEO

      rohanjha2019
      A
      license
      A
      quality
      C
      maintenance
      Enables AI agents to audit and improve a site's visibility in AI search by checking robots.txt against 17 major AI crawlers, detecting llms.txt, and returning a 0-100 visibility score with per-crawler verdicts; it also lists known AI crawlers and their purposes.
      2
      MIT

    • ai-visibility-mcp

      tsushanth
      A
      license
      A
      quality
      C
      maintenance
      Checks a website's robots.txt and Cloudflare settings to identify AI crawler blocking. Also generates llms.txt content to improve visibility to AI answer engines.
      3
      19 npm
      MIT

    • unrendered-mcp

      imfurkana
      A
      license
      Not graded
      quality
      C
      maintenance
      Lets an AI assistant check any URL to see how much of a page's main content is present in the raw HTML versus only after JavaScript runs, showing which text blocks, meta fields, canonical tags, JSON-LD and links AI crawlers like GPTBot and ClaudeBot cannot read. It also reports what robots.txt allows for 22 AI bot tokens and how the site responds to each bot's user-agent.
      AGPL 3.0

    • ai-visibility-mcp

      bestaiinsider
      A
      license
      A
      quality
      D
      maintenance
      Audits AI-bot visibility: robots.txt per-bot for 22 AI user-agents (GPTBot/ClaudeBot/PerplexityBot/etc), Cloudflare flags, JSON-LD, sitemap, llms.txt, SPA shell, plus cross-model brand mentions via Perplexity + OpenRouter. 0-100 score. SSRF-guarded, spend-capped.
      4
      1
      MIT

    • RobotsGate

      miketusa-ctrl
      A
      license
      Not graded
      quality
      C
      maintenance
      Enables AI assistants to list known AI crawlers such as GPTBot and ClaudeBot, generate and validate robots.txt rules, and check a live site's existing crawler directives. It runs as a remote Streamable HTTP MCP server exposing tools for crawler listing, rule generation, validation, and site checking.
      MIT
    • QueryRev AI Readiness by QueryRevAI

      QueryRev AI Readinessofficial

      QueryRevAI
      A
      license
      A
      quality
      C
      maintenance
      Checks a site for AI crawlers: which of 11 AI crawlers its robots.txt lets in, whether its llms.txt follows llmstxt.org, and what its home page says without scripts. Findings with evidence; no scores, no model calls, no telemetry.
      5
      MIT
    Deploy Server
    Shareable, User-Owned Context BackendPeople, applications, and agents read, write, and coordinate together in one context lake. Reach it over MCP, a CLI, a Python SDK, or REST.fulcradynamics.comAd

    TDQS

    A4/5.0

    Scored across 5 tools

    Disambiguation5/5

    Each tool targets a distinct operation: analyzing pasted content, checking a specific bot, fetching from a URL, generating, and listing bots. No overlap in functionality.

    Naming Consistency5/5

    All tool names follow a consistent verb_noun pattern with snake_case (e.g., analyze_robots, check_bot_status). No mixing of conventions.

    Tool Count5/5

    Five tools is a well-scoped set for this domain, covering the essential tasks without being too few or excessive.

    Completeness5/5

    The tools cover the full lifecycle: fetching, analyzing, checking specific bots, generating, and listing known AI bots. No obvious gaps for the intended purpose.

    Maintenance

    ActivityInactive
    ResponsivenessNo issues

    Resources