webscraping_ai_selected
Extract content from web pages using CSS selectors. Supports JavaScript execution, proxy types, and device emulation for flexible scraping.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| js | No | Execute on-page JavaScript using a headless browser (false by default). | |
| url | Yes | URL of the target page. | |
| proxy | No | Type of proxy: datacenter, residential, or stealth (datacenter by default). Use residential if the site restricts datacenter traffic, or stealth for the most heavily protected sites with advanced anti-bot detection. Residential and stealth requests cost more than datacenter — see the pricing page. | datacenter |
| device | No | Type of device emulation. | |
| format | No | Response format (json or text). | json |
| country | No | Country of the proxy to use (US by default). | |
| timeout | No | Maximum web page retrieval time in ms (20000 by default, maximum is 30000). | |
| selector | Yes | CSS selector to extract content for. | |
| wait_for | No | CSS selector to wait for before returning the page content. | |
| js_script | No | Custom JavaScript code to execute on the target page. | |
| js_timeout | No | Maximum JavaScript rendering time in ms (3000 by default). | |
| custom_proxy | No | Your own proxy URL in "http://user:password@host:port" format. | |
| error_on_404 | No | Return error on 404 HTTP status on the target page (false by default). | |
| error_on_redirect | No | Return error on redirect on the target page (false by default). |