AI crawler audit
audit_ai_crawlersAudit a site's AI search visibility by checking robots.txt rules for major AI crawlers and llms.txt presence, then receive a 0-100 score and per-crawler verdicts.
Instructions
Audit a site for AI search visibility: how robots.txt treats the major AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, ...) and whether llms.txt exists. Returns a 0-100 AI visibility score and per-crawler verdicts.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The site to audit, e.g. https://example.com |