batch_scrape
Scrape multiple websites simultaneously by submitting up to 100 URLs in one batch request with parallel processing and single webhook notification.
Instructions
Scrape multiple URLs in a single batch request.
Benefits:
Submit up to 100 URLs at once
Parallel processing for speed
Single webhook notification when all complete
Returns a batch_id and list of job_ids for tracking.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"urls": "<urls>"
},
"name": "batch_scrape"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | List of URLs to scrape (max 100) | |
| use_js_render | No | Enable JS rendering for all URLs | |
| use_residential | No | Use residential proxy for all URLs | |
| callback_url | No | Webhook URL for batch completion |