ai-visibility-mcp
ai-visibility-mcp
自身のプロパティに対して、AIクローラーや回答エンジン(ChatGPT、Claude、Perplexity、Google AI Overviewsなど)へのウェブサイトの可視性を確認し改善するためのMCPサーバー。
ほとんどの「AI SEO」のアドバイスは「llms.txtを追加する」で終わります。実際には、より大きく一般的な問題はその上流にあります。robots.txt(多くの場合CloudflareのようなCDNによって自動管理される)が、アクセスさせたいクローラーを静かにブロックしており、それによってllms.txtやコンテンツの作業を無意味にしています。このサーバーは両方をチェックし、さらに監査して修正を生成することもできます。
ツール
check_visibility(url)— サイトのライブのrobots.txtを取得し、名前の付いたAIボット(GPTBot、ClaudeBot、Google-Extended、PerplexityBot、Applebot-Extended、CCBot、Bytespider、Amazonbot、meta-externalagentなど)がDisallow: /でブロックされているか、ワイルドカードブロックがあるかをフラグします。また、llms.txtが実際のファイルとして存在するか、SPAのキャッチオールルートにフォールスルーしているか(よくある誤検出:ファイルは200を返すが、実際はホームページ)もチェックします。cloudflare_ai_bot_audit(domain)— 管理するドメインのCloudflareゾーンのBot Management AIボット設定(ai_bots_protection、ai_training、ai_search、ai_user、is_robots_txt_managed)を読み取ります。環境変数CLOUDFLARE_API_EMAIL+CLOUDFLARE_API_KEY(グローバルAPIキー)が必要です。generate_llms_txt(name, description, url, phrase?)—llms.txtの行を生成し、所有可能なニッチなphraseを指定すると、そのフレーズに基づいた小さなコンテンツパック(メタディスクリプション+FAQブロック)も生成します。純粋なテキスト生成であり、ファイルシステムやgitへの書き込みは行いません。
Related MCP server: ai-visibility-mcp
インストール
git clone https://github.com/tsushanth/ai-visibility-mcp.git
cd ai-visibility-mcp
npm install
npm run buildMCPクライアント設定(例:Claude Code、Claude Desktop)に追加します:
{
"mcpServers": {
"ai-visibility": {
"command": "node",
"args": ["/absolute/path/to/ai-visibility-mcp/dist/index.js"],
"env": {
"CLOUDFLARE_API_EMAIL": "you@example.com",
"CLOUDFLARE_API_KEY": "your-global-api-key"
}
}
}
}Cloudflare環境変数はcloudflare_ai_bot_auditにのみ必要です — check_visibilityとgenerate_llms_txtは設定なしで動作します。
なぜこれが存在するか
Cloudflare上のサイトでは、デフォルトでAIクローラーブロッキングが有効になっていることがよくあります(「Block AI Bots」トグル)。これにより、提供されるrobots.txtが書き換えられ、GPTBot、ClaudeBot、Google-Extendedなどが拒否されます。サイト所有者が明示的にその決定をしたことがなく、実際にはAI検索の可視性を望んでいる場合でもそうです。これは見逃しやすいです。なぜなら、サイトは人間の訪問者や通常の検索エンジンには正常に見え機能しているからです。AIクローラーのみが静かに拒否されています。check_visibilityは外部からこれを明らかにし(実際に提供されているもの)、cloudflare_ai_bot_auditはアカウント側(Cloudflareの設定が示すもの)から確認するため、両者を区別できます。
ライセンス
MIT
Available Tools
3 toolscheck_visibilityA
Check a site's actual AI-crawler visibility: fetch its live robots.txt and look for Disallow rules blocking named AI bots (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, etc.) or a wildcard block, plus whether llms.txt actually exists as a real file (vs. falling through to a SPA catch-all).
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Site URL or bare domain, e.g. example.com |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It explains the tool fetches a live resource and checks for specific bot names, which implies it's a read-only network operation. However, it doesn't disclose that it may make external requests, handle timeouts, or fail on invalid URLs. Given no annotations, the description does some work but misses key behavioral details.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single sentence, well-structured, and front-loaded with the tool's purpose. It is concise but covers the main actions without unnecessary detail. It earns its place but could be slightly more efficient in phrasing.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple tool with one parameter and no output schema, the description is reasonably complete. It explains what the tool fetches, what specific checks it performs (named bots, wildcard block, llms.txt existence), and the nuance of SPA catch-all. It doesn't explain the return format, but given the lack of an output schema, a 4 is appropriate.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The schema covers the single parameter (url) 100%, and the description adds meaning by explaining the parameter is a site URL or bare domain (e.g., example.com). The description also provides typical usage context (robots.txt fetch and llms.txt check), which goes beyond the schema's basic description.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool checks a site's AI-crawler visibility by fetching robots.txt and looking for Disallow rules for named AI bots and a wildcard block, and verifies llms.txt existence. It uses a specific verb (Check) and resource (site's AI-crawler visibility), distinguishing it from siblings like cloudflare_ai_bot_audit or generate_llms_txt.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides clear context on what the tool does (checking robots.txt and llms.txt). It doesn't explicitly state when NOT to use it or mention alternatives, but the sibling tools (cloudflare_ai_bot_audit and generate_llms_txt) imply different use cases. The description is sufficient for an agent to decide when to invoke this tool.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
cloudflare_ai_bot_auditA
Read a Cloudflare zone's Bot Management AI-bot settings (ai_bots_protection, ai_training, ai_search, ai_user, is_robots_txt_managed) for a domain. Requires CLOUDFLARE_API_EMAIL and CLOUDFLARE_API_KEY env vars (Global API Key, X-Auth-Email/X-Auth-Key auth).
| Name | Required | Description | Default |
|---|---|---|---|
| domain | Yes | Root domain as registered in Cloudflare, e.g. example.com |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of disclosing behavior. It explicitly states 'Read' (non-destructive), which is the most critical trait, and additionally documents required environment variables and authentication method. It does not elaborate on error cases or return format, but for a simple read operation this is sufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two sentences, each earning its place: the first states the core purpose and scope, the second specifies authentication requirements. No filler or redundant content.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a simple read tool with one parameter and no output schema, the description is largely complete: it lists the settings read, the domain, and the auth prerequisites. It does not describe the return structure, but the absence of an output schema makes that less critical. Minor gaps like error handling or zone-not-found behavior keep it from a 5.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema covers 100% of the single parameter (domain), giving its format and example. The description adds no new parameter semantics beyond what the schema already provides, so the baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the specific action ('Read a Cloudflare zone's Bot Management AI-bot settings') and enumerates the exact settings covered. The resource (Cloudflare zone) and the tool's focus are unambiguous, naturally distinguishing it from sibling tools despite not naming them.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage by stating what it reads and for which domain, but it does not provide explicit guidance on when to use this tool over alternatives, nor any exclusions. There is no mention of when not to use it or how it relates to sibling tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
generate_llms_txtA
Generate an llms.txt line plus a content pack (ownable phrase, llms.txt sentence, meta description, FAQ block) for a product, ready to hand-place on a landing page or drop as a file. Does not write files or touch git — pure text generation.
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Canonical URL | |
| name | Yes | Product name | |
| phrase | No | Ownable niche phrase to anchor on, e.g. "one-click autofill for Greenhouse, Lever, and Ashby job applications". If omitted, only llms.txt is generated (no content pack). | |
| description | Yes | One-sentence plain description of what it does |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
Since no annotations are provided, the description carries the burden of behavioral transparency. It clearly states that the tool is pure text generation (no file writing, no git interaction), which is helpful. However, it doesn't disclose potential limits, response format, or whether generation is deterministic or uses external services.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is two sentences with no wasted words. It front-loads the main purpose, specifies the output components, and clarifies constraints in a concise manner.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool has 4 parameters with 100% schema coverage, no output schema, and no annotations, the description provides a clear functional overview. However, it could be more complete by mentioning that the output includes the generated text (since no output schema exists) and whether the FAQ block is a fixed format or customizable.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the baseline is 3. The description adds value by explaining that the 'phrase' parameter is optional and that omitting it triggers only llms.txt generation (no content pack), which is not stated in the schema. This clarifies behavior beyond the schema.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool generates an llms.txt line plus a content pack (ownable phrase, llms.txt sentence, meta description, FAQ block) for a product, distinguishing it from siblings like check_visibility and cloudflare_ai_bot_audit by focusing on text generation for SEO/content, not visibility checks or bot audits.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description specifies when to use the tool (to generate content for a landing page or file drop) and what it does not do (does not write files or touch git), providing clear context. However, it doesn't explicitly exclude alternatives or mention when not to use this tool versus other content generation tools.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
3 tool updates
v0.1.0- First observed
check_visibility - First observed
cloudflare_ai_bot_audit - First observed
generate_llms_txt
TDQS
Scored across 3 tools
Each tool has a clearly distinct purpose: one checks live robots.txt and llms.txt, one audits Cloudflare's specific AI bot settings, and one generates llms.txt content. There is no overlap or ambiguity.
All names use snake_case and include a verb, but check_visibility and generate_llms_txt follow a verb_noun pattern while cloudflare_ai_bot_audit places the verb at the end of a compound noun. This slight inconsistency is minor and does not hinder readability.
Three tools is a reasonable number for a focused domain like AI crawler visibility. The scope is narrow enough that each tool earns its place without feeling sparse or excessive.
The tool set covers the core workflows: checking visibility, auditing a specific provider's settings, and generating content. However, it lacks support for other hosting providers beyond Cloudflare and does not include any write/modify capabilities, which may be expected in a visibility management server but is likely intentional as an analysis-only tool.
Maintenance
Related MCP Connectors
Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
Audit a site's visibility to ChatGPT, Perplexity, Claude and AI agents. Generates llms.txt.
Check website AI-readiness: Schema.org, llms.txt, E-E-A-T, robots.txt. Works in Cursor & Claude.
Generate 18 AI readiness files (llms.txt, ai.txt, RAG indexes, schema) for any website.
Related MCP Servers
- AlicenseAqualityCmaintenanceAnalyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.51MIT
- AlicenseAqualityDmaintenanceAudits AI-bot visibility: robots.txt per-bot for 22 AI user-agents (GPTBot/ClaudeBot/PerplexityBot/etc), Cloudflare flags, JSON-LD, sitemap, llms.txt, SPA shell, plus cross-model brand mentions via Perplexity + OpenRouter. 0-100 score. SSRF-guarded, spend-capped.41MIT
- AlicenseAqualityBmaintenanceEnables AI agents to check whether a public website is crawlable, understandable, and ready for AI search workflows through local-only audits of robots.txt, sitemaps, metadata, and llms.txt.345 npm1MIT
- AlicenseAqualityCmaintenanceEnables inspection of any website's AI-search readiness, checking AI crawler blocks, llms.txt, schema markup, and indexing directives from MCP clients like Claude.434 npmMIT