Check AI crawler access
check_ai_crawler_accessCheck whether AI crawlers (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-User, PerplexityBot, Google-Extended, CCBot) may access a public URL according to its robots.txt, and score the page's machine readability (status, title, meta description, canonical, JSON-LD, server-rendered text). Returns a 0-100 score and a list of findings.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public page URL or domain, e.g. "https://example.com/pricing". |