fetch_pages
Fetch multiple web pages concurrently, returning JSON results and errors. Enable JavaScript rendering for dynamic sites, and save large batches to a table for later querying.
Instructions
Fetch many web pages in parallel. Returns JSON with results and errors. Set js_render=true for JavaScript-heavy pages. For more than about 20 URLs, pass save_as='' to write the pages into a result table and get back a summary instead of the full text — then use query_table to interrogate it without filling the conversation. When feeding a long URL list through in batches, pass mode='append' on every call after the first, or each batch replaces the last.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| mode | No | replace | |
| urls | Yes | ||
| save_as | No | ||
| wait_ms | No | ||
| wait_for | No | ||
| js_render | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |