llms.txt Compliance Checker
llms-txt-auditorGive it a domain. It checks whether the site publishes a valid llms.txt / llms-full.txt (the emerging AI-crawler-friendly-docs convention) and whether robots.txt blocks GPTBot, ClaudeBot, Google-Extended, PerplexityBot and 5 other AI crawlers. llms.txt-first, no browser, no LLM, no API key. — $0.01/call, x402 (USDC on base).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| items | Yes | List of domains to audit for llms.txt presence and AI-crawler robots.txt policy. | |
| maxConcurrency | No | How many domains to audit in parallel. |