SHORT KESTREL
check_ai_crawler_accessFREE. Before fetching a URL, learn whether your crawler identity will be served, refused, or met by a paid tollgate (Cloudflare Pay Per Crawl, TollBit, a bare 402) — from a standing census, with the price where published and whether the site varies by user-agent. Unknown URLs return "unknown" and schedule themselves. Bulk: triage_ai_crawler_access. Observational (a datacenter vantage), not a guarantee.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The page whose crawler-access posture to look up. http or https. |