batch_scrape
Scrape many URLs in a single parallel call with automatic deduplication and caching. Isolates per-URL failures so other pages still succeed.
Instructions
Scrape MANY URLs in ONE call (parallel, deduped, cache-aware).
Use when the user provides multiple URLs or you have a list of pages
to fetch. More efficient than calling scrape N times.
Args: urls: Target URLs (deduped automatically; empties dropped). prefer: "auto" | "fast" | "stealth" | "llm". timeout: per-URL timeout in seconds. max_concurrency: parallel workers (default 4). include_html: include raw HTML per result (large; off by default).
Returns {requested, unique, succeeded, failed, results[]}. Per-URL failures are isolated — other URLs still succeed.
Returns: {requested, unique, succeeded, failed, results: [{url, markdown, ...}]}
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | ||
| prefer | No | auto | |
| timeout | No | ||
| include_html | No | ||
| max_concurrency | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||