batch_crawl
Crawl multiple URLs simultaneously to extract web content, with options for markdown generation, media extraction, and JavaScript rendering.
Instructions
Crawl multiple URLs with fallback. Max 3 URLs per call.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | URLs to crawl (max 3) | |
| base_timeout | No | Timeout per URL (default: 30) | |
| generate_markdown | No | Generate markdown (default: True) | |
| extract_media | No | Extract media (default: False) | |
| wait_for_js | No | Wait for JS (default: False) | |
| max_concurrent | No | Max concurrent (default: 3) |