Start a background crawl
islamweb_start_crawlStart a resumable background crawl of an islamweb library book's content ID range, writing each fetched page as JSON lines to a file and returning a jobId for status polling.
Instructions
Starts crawling a contiguous range of content ids from one islamweb library book in the background (this call returns immediately with a jobId; poll islamweb_crawl_status with it). Each fetched page is appended as one JSON line to outFile as soon as it is parsed, so the crawl is resumable: re-running with the same outFile skips ids already present in it. Defaults are set up for لسان العرب لابن منظور (bookId 122, ids 1..9305) — omit bookId/startId/endId/outFile to crawl the whole dictionary.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| endId | No | defaults to 9305 | |
| bookId | No | defaults to 122 | |
| delayMs | No | delay after each request per worker, default 250ms | |
| outFile | No | defaults to data/lisan-al-arab.jsonl | |
| startId | No | defaults to 1 | |
| concurrency | No | parallel requests, default 3 |