spidra_crawl_pages
Read a crawl's pages in order with pagination to retrieve results beyond the first 100 pages or recover pages from a cancelled crawl, including Markdown and HTML links.
Instructions
Read a crawl's pages, in order, with each page's data and links to its Markdown and HTML (the links last 1 hour). Use it for crawls of more than 100 pages, since spidra_get_job returns only the first 100, or after a cancelled crawl to get the pages it finished.
Page through with "offset" and "limit" until "hasMore" is false. Keep "limit" small (20 to 50) to save context. Each page's "id" is what spidra_retry_crawl_page needs.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"jobId": "<jobId>"
},
"name": "spidra_crawl_pages"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| jobId | Yes | The crawl's jobId | |
| limit | No | Pages to return (default 50 here) | |
| offset | No | Pages to skip (default 0) |