Web Scrape Batch (up to 20 URLs to Markdown)
web_scrape_batchBulk web scraper: read up to 20 web pages in ONE paid call, each as clean, LLM-ready Markdown with title and meta description. One payment instead of 20, pages fetched in parallel, duplicate URLs read once. Use when your agent works through a list of URLs (search results, product pages, a sitemap, a link list). A failed page is reported with its error while the others still return; charged only if at least one page was read. For a single URL use web-scrape, to find the URLs of one site first use site-map. Params: urls (1 to 20, required), max_chars per page (500 to 30000, default 8000), include_links. Price: $0.05 USDC per call, paid inside this MCP call via x402 (USDC on Base, Solana, Polygon or Arbitrum). x402 MCP clients such as @x402/mcp pay automatically. Free sample: call with the example input {"urls":["https://example.com/","https://agentsvc.io/","https://agentsvc.io/docs"],"max_chars":3000}.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | 1 to 20 public http(s) URLs | |
| max_chars | No | Maximum Markdown characters per page | |
| include_links | No | Also return up to 100 absolute links per page |