Which AI crawlers your robots.txt lets in
get_crawler_accessWhether this business's robots.txt allows or blocks each documented AI crawler: OpenAI, Anthropic, Google, Perplexity, Apple, Microsoft, Meta and Common Crawl, split by what each one is for (search, model training, or fetching a page because a user asked). Read from the stored evidence of the latest deep scan, with the matching robots.txt rule quoted for each. Also names vendors this checker cannot assess, so an agent does not read silence as permission.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||