Read AI crawler visits
read_crawl_logsRead the AI crawler requests your server logs recorded, to see which crawlers actually visited, what they fetched and what they got back. View summary (the default) gives totals: requests, pages, active crawlers, error share and a daily series by purpose. View crawlers gives one row per crawler with status codes and verification. View coverage says how complete each day of logs is. View requests lists individual requests. The window defaults to the last 30d, except that requests without range or dates reads every retained day. The paged views return 10 rows by default (up to 100) with a top-level next_cursor; changing a filter needs a new first page, while a continuation may change limit. Failed-verification requests are left out unless verification asks for them. connection not_connected or missing coverage means unknown, not zero. Use read_ai_crawlability for robots permission and read_ai_traffic_pages for activity per page.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| view | No | summary is totals; crawlers is one row per AI crawler; coverage is how complete each day of logs is; requests lists individual requests, paged. | summary |
| limit | No | How many rows to return; omit for the default page size. | |
| range | No | A preset window ending today; or pass start_date and end_date instead. | |
| bot_id | No | A bot_id the crawlers view returned; keep only that crawler. | |
| cursor | No | The next_cursor a previous page returned. | |
| folder | No | A site path prefix such as /blog/ to read only pages under it. | |
| status | No | An HTTP status code; keep only requests answered with it. | |
| end_date | No | Last day of a custom window, inclusive. | |
| project_id | Yes | A project id that list_projects returned. | |
| start_date | No | First day of a custom window, inclusive. | |
| verification | No | Keep only crawler requests whose claimed identity was verified, could not be verified, or failed verification. | |
| resource_class | No | A resource_class a previous row returned, such as page, to read only that kind. |