scrape-dom
Scrape web pages and extract structured data using CSS selectors, with support for pagination and low-level DOM operations.
Instructions
Scrape a URL, parse with jsdom, and extract data via structured DSL or low-level operations. Supports pagination.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to scrape | |
| method | No | HTTP method | GET |
| extract | No | Structured extraction DSL. Mutually preferred over operations for item scraping | |
| headers | No | Custom HTTP headers | |
| retries | No | Retry attempts (0-10) | |
| timeout | No | Timeout in ms (1000-120000) | |
| operations | No | Low-level DOM operations to run on each page (pipeline mode) | |
| pagination | No | Follow next-page links and accumulate results |