run_scraper
Execute a scraper method on URLs or queries to collect or discover public web data, returning records or a snapshot_id to poll when the run exceeds 45 seconds.
Instructions
Run a scraper method. input is a list of objects shaped like sample_input from get_scraper_details, one per URL or query. collect_by_url returns one record per input; discover_by_* methods return up to limit_per_input records per input, and every record is billed. Waits up to 45 seconds; if still running it returns snapshot_id with status "running": then poll get_scraper_progress and call get_scraper_results when ready. Records with an "error" field explain failed inputs.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| input | Yes | ||
| method | Yes | One of the scraper collection_methods, exactly as listed (some names are misspelled on purpose) | |
| dataset_id | Yes | dataset_id from search_scrapers | |
| limit_per_input | No | discover_by_* only |