Fetch the root page as a named crawler
fetch_as_crawlerWhat Googlebot, Bingbot, OAI-SearchBot, PerplexityBot, ClaudeBot or GPTBot receive from the site: status, redirects, headers and extracted text. Shows CDN or firewall blocks that robots.txt cannot.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| agent | Yes | ||
| domain | Yes | The domain to check, as the person gave it (no scheme, no path). Reserved names such as example.com are refused. |