Batch Scrape URLs
metalift_batch_scrapeBatch scrape up to 100 URLs in parallel into LLM-ready markdown, with background job support and options for JavaScript-heavy pages.
Instructions
Scrape up to 100 URLs in parallel (billed per URL). Default response_detail=compact. Use async=true for background jobs; wait=true blocks with progress. For JS-heavy pages set strategy=auto in scrape_options. You are solely responsible for complying with website terms, robots.txt, copyright, and data protection laws when using scraped content.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | URLs to scrape in parallel | |
| wait | No | When async=true, wait for completion with progress updates (default true). | |
| async | No | Run as background job (returns job id) | |
| scrape_options | No | Shared scrape options applied to every URL in the batch |