List which bot asked for which page
list_crawlsCheck crawl history per page and bot to see which paths AI assistants and search engines fetched, when, and their last status code.
Instructions
One row per path and bot: when that bot first and last asked for the path, how many times, and the status it got the last time. Unlike list_bot_visits this covers everything since tracking began rather than a period, and is ordered by the last visit.
Coverage rather than volume. A page a bot has never fetched does not appear here at all, and cannot be quoted by that bot however well it answers the question. A lastStatusCode outside the 2xx range is worse than silence: the last thing that bot recorded about the page is that it was broken, and it carries that until it comes back.
Paths are in the same form get_sitemap reports, so an address listed there with no row here is a page nothing has ever come for.
Only the 3 000 most recently visited rows are searched, unless path names one page, which reads all of its rows.
A bot visit is a machine fetching a page, not a person reading one. It is the supply side of visibility: an assistant can only quote a page its bot was able to fetch, so this says whether the site is reachable and readable to them at all. It is a different measurement from being named in an answer (list_prompts, list_competitors), from being cited as a source (list_sources), and from somebody arriving afterwards (get_ai_traffic). kind=ai is the assistants; kind=seo is classic search engines and SEO tools.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| kind | No | `ai` for AI assistants and their bots, `seo` for search engines and SEO tools. Omit it for both. | |
| path | No | Only this exact path, without the domain and starting with `/`, e.g. `/pricing`. | |
| botId | No | Only this one bot, by the id the other traffic tools report — `chatgpt-user`, `gptbot`, `googlebot` and so on. An unknown id is rejected by the API rather than ignored. | |
| limit | No | How many entries to return, at most 200. Defaults to 50. | |
| cursor | No | The nextCursor of the previous page. Omit it to start from the first one. | |
| vendor | No | Only bots run by this company, spelled as the API spells it: OpenAI, Anthropic, Google, Perplexity, Meta, Amazon, Apple, Microsoft, ByteDance, Yandex, DuckDuckGo, Ahrefs, Semrush, Moz, CommonCrawl, Mistral, Cohere and others. This is not the `assistant` of get_ai_traffic, which matches a referrer instead. |