Poll a job
pagesift_poll_jobPoll a crawl or batch-scrape job to get its status, progress, and pages collected so far; poll again while scraping and stop when status is final.
Instructions
Get the status, progress and pages collected so far for a pagesift_crawl or pagesift_batch_scrape job. status is scraping, completed, cancelled or failed; completed, cancelled and failed are final. While scraping, poll again after a few seconds; stop when the status is final. Pages collected so far are in data and remain available for 24 hours. Use pagesift_cancel_job to stop a running job.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"id": "<id>"
},
"name": "pagesift_poll_job"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| id | Yes | Job id returned by pagesift_crawl or pagesift_batch_scrape. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| data | Yes | Pages collected so far. | |
| total | Yes | Pages known so far; grows during a crawl. | |
| errors | No | Number of page-level errors recorded so far. | |
| status | Yes | Job state. completed, cancelled and failed are final. | |
| completed | Yes | Pages completed so far, including failed pages. | |
| expiresAt | Yes | When the job and its pages are removed (24 hours after creation). | |
| robotsBlocked | No | URLs skipped because robots.txt disallows them. |