extract_structured_data_cdp
Scrape JavaScript-rendered web pages by loading them through CDP, then extract structured records using CSS or XPath selectors. Ideal for dynamic content that requires full page rendering.
Instructions
Fetch a rendered page through CDP and extract structured records from the rendered DOM.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>",
"fields": "<fields>"
},
"name": "extract_structured_data_cdp"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| label | No | ||
| fields | Yes | ||
| headers | No | ||
| item_limit | No | ||
| item_xpath | No | ||
| ws_endpoint | No | ws://127.0.0.1:9222 | |
| item_selector | No | ||
| max_size_bytes | No | ||
| store_document | No | ||
| timeout_seconds | No | ||
| truncate_on_limit | No | ||
| include_source_url | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| via | No | cdp | |
| items | No | ||
| status | No | ||
| headers | No | ||
| summary | Yes | ||
| final_url | Yes | ||
| scope_mode | No | ||
| scope_query | No | ||
| total_scopes | Yes | ||
| omitted_items | Yes | ||
| returned_items | Yes | ||
| document_handle | No |