A
licenseNot graded
qualityB
maintenanceEnables users to check whether GPTBot, ClaudeBot, PerplexityBot, Googlebot and other AI/search crawlers can reach a specified page, distinguishing robots.txt blocks from server or firewall refusals.
MIT
Check if AI crawlers like GPTBot and ClaudeBot can reach, index and quote any web page.
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Checks if GPTBot, ClaudeBot, PerplexityBot, Googlebot and 9 more AI crawlers can reach a page.
See what GPTBot, ClaudeBot and other crawlers get from a site: robots.txt checks and AI scans.
Checks whether a website is readable and citable by AI systems (ChatGPT, Claude, Perplexity, etc.)
Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index
Add one secure layer between your agents and this server.