page.batch_analyze
Batch analyze multiple URLs in parallel with configurable concurrency and validation. Submit up to 50 URLs, track progress via batch ID, and handle individual failures gracefully.
Instructions
Batch analyze multiple URLs in parallel. Submits all URLs as async BullMQ jobs and returns immediately with a batch ID.
Features:
Up to 50 URLs per batch
Configurable concurrency (1-5, default: 3)
SSRF validation for all URLs before submission
Graceful degradation: individual failures don't affect the batch
Progress tracking via page.getBatchStatus
Rate limiting within analysis tier (10 RPM)
Use page.getBatchStatus to poll for results.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | Target URLs to analyze (1-50) | |
| timeout | No | Batch-level timeout in ms (default: 1800000 = 30min) | |
| features | No | Shared analysis features (default: all enabled) | |
| on_error | No | Behavior on individual job failure: 'skip' (continue) or 'abort' (stop batch) | |
| concurrency | No | Parallel jobs within batch (1-5, default: 3) | |
| layoutOptions | No | Shared layout options for all URLs | |
| respect_robots_txt | No | Respect robots.txt (default: true) |