webextrator_render
Render a web page in a headless browser to obtain the fully rendered HTML after JavaScript execution, ideal for capturing dynamic content from JavaScript-heavy sites and single-page applications.
Instructions
Render a web page and return the fully rendered HTML.
Uses a headless browser to navigate to the specified URL, waits for JavaScript
to execute, and returns the final rendered HTML source.
Use this when:
- You need the fully rendered HTML of a JavaScript-heavy page
- You want to inspect the DOM after dynamic content has loaded
- You need to capture single-page application (SPA) content
Returns:
JSON response containing the rendered HTML content.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL of the web page to render. Required. | |
| mode | No | Processing mode. 'sync' (default) waits for the result; 'async' returns immediately with a task_id to poll via the Tasks API. | |
| delay | No | Extra delay in seconds after page load before capturing HTML. | |
| cookies | No | Cookies to install before navigation. Each cookie is an object with at least 'name' and 'value', plus optional 'domain', 'path', 'expires', 'httpOnly', 'secure', 'sameSite'. Useful for authenticated pages. | |
| headers | No | Extra HTTP headers to include with the page request. | |
| timeout | No | Total timeout in seconds for page load. Default is 30. | |
| user_agent | No | Override the User-Agent header for the page request. | |
| wait_until | No | Page load wait condition before capturing HTML. Options: 'load', 'domcontentloaded', 'networkidle', 'commit'. Default is 'networkidle'. | |
| bypass_cache | No | Skip the Redis result cache for this request (still writes the fresh result back). Default is false. | |
| callback_url | No | Callback URL for async processing. If provided, the task runs asynchronously and results are sent to this URL when complete. | |
| block_resources | No | Resource types to block during page load to speed up rendering. Options: 'image', 'font', 'media', 'stylesheet', 'xhr', 'fetch'. | |
| cache_ttl_seconds | No | Override the global cache TTL (seconds) for this entry. 0 means do not cache this response. Default is 3600. | |
| wait_for_selector | No | CSS selector to wait for before capturing HTML. |
Output Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |