Scrape a URL
surfsky_scrapeFetch a single URL in a cloud browser and return clean markdown, HTML, links, or a screenshot with final URL and status. Read any page without managing a session.
Instructions
Fetch one URL in a throwaway cloud browser and return it as markdown (default), cleaned html, a list of links, and/or a viewport screenshot, with the final url, HTTP status and title. Use it whenever you only need to read a page: it starts no session, so there is nothing to stop, and it runs a real browser behind a residential proxy like the session tools. For a page that needs clicks, scrolling, a form or an interactive login, use surfsky_navigate, surfsky_act and surfsky_read; for a saved login pass profile_uuid here. A status of 200 with a short page may be a challenge page: read the content before trusting it. Text longer than max_chars is cut with a marker. Each call bills one short session.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| os | No | Fingerprint operating system. Not allowed with profile_uuid. | |
| url | Yes | URL to fetch; https:// is added when the scheme is missing. | |
| city | No | Proxy exit city, with country. | |
| proxy | No | Omit for the account default. 'premium': the residential pool (proxy_type 'mobile' for mobile IPs). 'shared': the free pool, tests only. Or your own proxy URL (user:pass@host:port); then country, region, city and proxy_type are not allowed. | |
| region | No | Proxy exit state or region, with country. | |
| country | No | Proxy exit country code, for example US. | |
| formats | No | One or more of markdown, html, links, screenshot (viewport JPEG). Default: markdown. | |
| timeout | No | Seconds to wait for the navigation (default 30). | |
| wait_for | No | CSS selector to wait for before reading, for content that appears after the load event. | |
| max_chars | No | Cut each text after this many characters (default 30000, at most 200000). | |
| proxy_type | No | Pool for Surfsky proxies: 'residential' (default) or 'mobile'. | |
| wait_until | No | Load state that ends the navigation: 'load' (default), 'domcontentloaded' (faster on heavy pages; then surfsky_wait for what you need), 'commit' (first response received), 'networkidle' (no requests for a while; busy pages never reach it and time out). | load |
| profile_uuid | No | Saved Surfsky profile to load: its cookies and logins come with it and are saved back on a normal stop. Only a uuid the user gave you. Not combinable with os, os_version or arch: the profile owns its fingerprint. | |
| block_resources | No | Resource types the browser does not download: faster and less proxy traffic, but screenshots and layout lose them. | |
| only_main_content | No | Drop navigation, headers, footers, asides and forms; keep the main or article content. |