check_ai_access
Read a site's robots.txt to list which AI crawlers may access it, separating those that fetch pages for live answers from those that only collect training data. Know the AI visibility impact per type.
Instructions
Read a site's robots.txt and say which AI crawlers may fetch it, separating the ones that retrieve pages to answer live questions from the ones that only collect training data. Blocking the first kind is what makes a site invisible in AI answers; blocking the second costs nothing. Runs locally, no account needed.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | A public site, e.g. example.com or https://example.com |