Trigger a Crawl / Web Scraper job
web_scraper_triggerTrigger data collection from one or more URLs via Bright Data, returning a snapshot ID to poll for results.
Instructions
Trigger a Bright Data dataset (Web Scraper / Crawl API) collection over one or more URLs. Returns a snapshot_id to poll with web_scraper_get_results. Requires a dataset_id (gd_...) - either passed here or via BRIGHTDATA_DATASET_ID.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | Target URLs to collect. | |
| dataset_id | No | Dataset id (gd_...). Defaults to BRIGHTDATA_DATASET_ID. | |
| extra_inputs | No | Advanced: full input objects instead of plain URLs (overrides 'urls'). | |
| include_errors | No | ||
| custom_output_fields | No | Pipe-separated output fields, e.g. 'url|markdown'. |