citefiles_crawler_access
Test how a website answers the real AI crawlers — GPTBot, ClaudeBot, PerplexityBot and Google-Extended — by requesting its homepage as a browser and again as each crawler, then comparing. Catches CDN and WAF rules that block assistants without the owner knowing. Use when a site looks correct but is not being cited.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The public website address. |