Scrape multiple URLs concurrently (cost-aware)
smart_scrape_batchFetch multiple URLs in parallel using free-first routing, returning structured results per URL. Use for batch web scraping to avoid looping individual requests.
Instructions
Fetch an array of URLs in parallel using the same free-first routing as smart_scrape. Returns an array of {url, success, text, tier, paid} objects. Use this instead of calling smart_scrape in a loop — it's significantly faster.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | URLs to fetch (max 50). | |
| free_only | No | ||
| concurrency | No | Max parallel fetches. | |
| data_format | No | markdown | |
| rate_limit_ms | No | ||
| direct_timeout_ms | No | ||
| force_bright_data | No |