What crawlers fetched
crawl_reportWhat search engine, AI and SEO crawlers actually fetched in the last hours (default 24, up to 168), from the web server's access logs: per crawler the hits, status codes (404, 5xx, redirects), what kind of pages (filtered layered-navigation URLs, search, ordinary pages, static files, API), URLs with a query string, the most fetched, 404 and 5xx paths, Googlebot and Bingbot hits per hour, and for Googlebot and Bingbot how many hits really come from them (reverse DNS) and which addresses fake it. Use it for technical SEO (crawl budget, errors served to Google) next to Search Console data. Pass log for one site's access log when the server has several.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| log | No | Path of an access log (combined format); default: all nginx/Apache access logs | |
| hours | No | 1 to 168, default 24 | |
| server | No | Server name or id. Optional when the account has one server. |