AI crawler checker
check_ai_crawler_accessChecks whether the crawlers behind ChatGPT, Claude, Perplexity, Google AI Overviews, Copilot and 14 more may read a page: robots.txt rules (RFC 9309), robots meta and X-Robots-Tag directives, and whether the site's firewall refuses each crawler's user agent. Separates search and user crawlers (which decide whether you can be cited) from training crawlers (which do not). Free, no key. Docs: https://aeolookup.com/aeo-tools/ai-crawler-checker/
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The page or site to check, for example https://example.co.uk/ (https:// is added if missing). | |
| path | No | Optional path to test instead of the URL's own path, for example /blog/. |