caelara_seo_ai_bot_robots_check
Checks whether AI crawlers like GPTBot, PerplexityBot and Google-Extended are allowed by a site's robots.txt, so you can verify SEO and generative engine readiness.
Instructions
[SEO & GEO Readiness] Check whether GPTBot, PerplexityBot, Google-Extended and other AI crawlers are allowed by robots.txt Measured p50 13 ms, p95 15 ms (2026-11-21, benchmarks.caelaralabs.com). Calls https://seo.caelaralabs.com.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "caelara_seo_ai_bot_robots_check"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL (path is evaluated against robots.txt) |