extract_data
Scrape a webpage and pull specific fields with CSS selectors, including text or attributes from JavaScript-rendered sites, then return or save results as JSON.
Instructions
Scrape a webpage and extract specific data using CSS selectors.
Args:
url: The webpage to scrape
css_selectors: List of CSS selectors (e.g., ["h1", "a.link", "#content"])
attributes: List of attributes to extract for each selector (e.g., ["text", "href", "text"])
If not provided, defaults to "text" for all selectors
javascript: Set to True for JavaScript-rendered sites
save_path: Optional file path to save the result as JSON (e.g. "C:/Users/me/Desktop/result.json").
If a directory is given, a timestamped filename is generated automatically.
Returns:
Dictionary with extracted data for each selector
Example:
extract_data(
url="https://example.com",
css_selectors=["h1", "a"],
attributes=["text", "href"]
)
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| save_path | No | ||
| attributes | No | ||
| javascript | No | ||
| css_selectors | Yes |
Output Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |