spidra_batch_scrape
Scrape 2-50 URLs in parallel using the same prompt or schema, with each URL returning its own result. Returns a batchId for async status polling.
Instructions
Scrape a list of 2-50 known URLs in parallel with the same extraction prompt/schema. Each URL is processed INDEPENDENTLY and gets its OWN result (unlike spidra_scrape, which merges multiple URLs into one combined answer). This tool returns IMMEDIATELY with a batchId — it does not wait.
Best for: running the same extraction on each of many similar pages (product pages, listings, articles) where you need separate data per URL — even for just 2 URLs. Workflow: call this, then poll spidra_check_batch_status with the batchId every 10-15 seconds until the batch reaches a terminal state. Do NOT resubmit while a batch is pending.
Costs: 2 credits per URL plus AI tokens. Failed items can be retried from the dashboard or cancelled with spidra_cancel_batch (credits for unprocessed items are refunded).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | 2-50 URLs to scrape in parallel (plain strings) | |
| output | No | ||
| prompt | No | What to extract from each page. Omit for raw markdown. | |
| schema | No | JSON Schema enforcing the exact output shape. Define EVERY field you want extracted — an untyped object with no properties comes back empty. Missing fields return null instead of hallucinated values. | |
| cookies | No | ||
| useProxy | No | Route through a residential proxy (for blocked/geo-restricted sites) | |
| scrapeMode | No | ||
| proxyCountry | No | Two-letter country code for the proxy, e.g. "us", "de", "jp", or "eu"/"global" | |
| extractContentOnly | No |