Check AI crawler access
check_ai_accessWhich AI crawlers the site's robots.txt lets in, per bot, at the home page and at a content path. Free, read-only. Without url it checks profile.siteUrl, and the content path is the blog prefix import_sitemap detected. bots groups each crawler as search (behind an AI product's citations), user (a fetch a person asked for; honorsRobots false means the operator says it may ignore robots.txt) or training (model training only; blocking it does not remove the site from that operator's answers, it is the owner's choice). findings is ordered by severity: googlebot-blocked, robots-unreachable and search-bots-blocked are critical, user-bots-blocked and cloudflare-edge are warnings, training-bots-blocked and llms-txt-missing are informational. There is no score. It reads robots.txt, /llms.txt and the home page headers only: a CDN or firewall can still block a bot robots.txt allows, which is what cloudflare-edge warns about.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | ||
| workspaceId | No | The workspace this call acts on, as listed by list_workspaces. Left out, the call uses the workspace the account is in right now. |