AI crawler access check
ai_crawler_access_checkReads a website's public robots.txt and llms.txt and reports whether AI crawlers from OpenAI, Anthropic, Perplexity and Google (GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended and others) are allowed, restricted or blocked.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| domain | Yes | Public domain to check, for example example.com. |