web_scrape_batch
Read up to 20 web pages in one paid call, converting each to clean Markdown with title and meta description for LLM-ready bulk scraping.
Instructions
Web Scrape Batch (up to 20 URLs to Markdown) — Bulk web scraper: read up to 20 web pages in ONE paid call, each as clean, LLM-ready Markdown with title and meta description. One payment instead of 20, pages fetched in parallel, duplicate URLs read once. Use when your agent works through a list of URLs (search results, product pages, a sitemap, a link list). A failed page is reported with its error while the others still return; charged only if at least one page was read. For a single URL use web-scrape, to find the URLs of one site first use site-map. Params: urls (1 to 20, required), max_chars per page (500 to 30000, default 8000), include_links. Cost: $0.05 USDC per call. Latency p99: 20000ms.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | 1 to 20 public http(s) URLs | |
| max_chars | No | Maximum Markdown characters per page | |
| include_links | No | Also return up to 100 absolute links per page |