audit_domain_ai_llms_readiness
Check a domain for llms.txt support, robots.txt permissions for AI crawlers (GPTBot, ClaudeBot, PerplexityBot), and Schema.org metadata. Reveal AI discoverability gaps.
Instructions
Audit any domain for /llms.txt standard support, robots.txt AI Bot crawler permissions (GPTBot, ClaudeBot, PerplexityBot), and Schema.org semantic metadata.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| html | No | Optional homepage HTML for offline testing | |
| domain | Yes | Target domain or hostname (e.g. "anthropic.com" or "stripe.com") | |
| llmsTxt | No | Optional llms.txt content for offline testing | |
| proApiKey | No | PRO API Key for unlimited lookups | |
| robotsTxt | No | Optional robots.txt content for offline testing |