extract_structured_data_cdp
Scrape JavaScript-rendered web pages by loading them through CDP, then extract structured records using CSS or XPath selectors. Ideal for dynamic content that requires full page rendering.
Instructions
Fetch a rendered page through CDP and extract structured records from the rendered DOM.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| label | No | ||
| fields | Yes | ||
| headers | No | ||
| item_limit | No | ||
| item_xpath | No | ||
| ws_endpoint | No | ws://127.0.0.1:9222 | |
| item_selector | No | ||
| max_size_bytes | No | ||
| store_document | No | ||
| timeout_seconds | No | ||
| truncate_on_limit | No | ||
| include_source_url | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| via | No | cdp | |
| items | No | ||
| status | No | ||
| headers | No | ||
| summary | Yes | ||
| final_url | Yes | ||
| scope_mode | No | ||
| scope_query | No | ||
| total_scopes | Yes | ||
| omitted_items | Yes | ||
| returned_items | Yes | ||
| document_handle | No |