scrape
Fetch the full HTML of any URL, with optional JavaScript rendering, residential proxy, geotargeting, session reuse, and stealth mode to bypass captchas.
Instructions
Scrape any URL via the Scrapingdog Web Scraping API (/scrape). Returns the page's HTML. Supports JS rendering (dynamic), premium residential proxies, geotargeting (country), sessions, stealth/captcha bypass, and a render wait. Costs 1–25 credits depending on options.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL of the page to scrape. | |
| wait | No | Milliseconds to wait after JS rendering before capturing HTML (0–35000). Use with dynamic=true. | |
| image | No | Scrape image URLs found on the page. | |
| api_key | No | Override the configured Scrapingdog API key for this call. If omitted, the key is read from SCRAPINGDOG_API_KEY or a local .env file. | |
| country | No | ISO country code for geotargeting (e.g. 'us', 'gb', 'in'). Sends the request from that location. Costs 10 credits. | |
| dynamic | No | Enable JavaScript rendering with a headless browser. Costs 5 credits (25 with premium proxy). | |
| premium | No | Use premium residential proxies instead of the rotating datacenter proxy. Costs 10 credits (25 with JS rendering). | |
| stealth_mode | No | Enable stealth mode to bypass bot detection / captchas. | |
| custom_headers | No | Set to true to forward your own request headers (passed via the headers parameter). | |
| session_number | No | Reuse the same proxy/IP across multiple requests by passing a stable session string. |