crawl_status
Poll a crawl job for incremental progress, receiving only pages crawled since the last check. Set include_content only when page text is required to avoid large payloads.
Instructions
Poll a crawl job for progress and the pages crawled so far. Polls are incremental: pass the previous response's nextCursor as since to receive only the pages crawled since your last poll. Pages omit their content by default — set include_content true only when you actually need the text (a large crawl's full content can be hundreds of KB).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| jobId | Yes | The crawl job id returned by crawl | |
| since | No | Page cursor from the previous poll's `nextCursor` — returns only newer pages | |
| include_content | No | Include each page's full content (default false — metadata only) |