AI-crawler access report
ai_crawler_accessGiven a website domain, reports which AI crawlers may fetch its home page under its robots.txt (RFC 9309): GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Applebot-Extended, CCBot and more, each allowed or blocked, plus Googlebot, listed sitemaps, whether /llms.txt is published and page-level noindex/nosnippet, with fixes. Static check, no browser. Not charged if robots.txt cannot be read (no response, or a bot block). Costs $0.01 USDC per successful call (x402, eip155:8453); failures are not charged.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| domain | Yes | Bare domain, no scheme or path, e.g. mailchimp.com |