crawl_results
List the URLs kept by a crawl in order, track content status, and use next_cursor to resume partial runs and fetch newly kept pages.
Instructions
List the URLs a crawl kept, in the order it kept them, following the API's pages up to limit.
Each result has url and, when the crawl has output_format, content_status (pending, fetched, failed) and, once fetched, content_url: pass it to crawl_content as content.
While the crawl runs the list is partial (partial=true): call again later with the returned next_cursor to get only the URLs kept since. A stopped crawl can still add URLs from pages fetched before the stop for up to 10 minutes, so next_cursor stays set during that window: call again later. next_cursor is null once the crawl ended and every URL was read.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | Max results to return in this call (default 100, max 10000) | |
| cursor | No | next_cursor from a previous crawl_results call, to continue from there | |
| crawl_id | Yes | Crawl id returned by crawl_create (c_…) |