Scrape a URL (quality-gated)
scrape_urlScrape a public web page into clean markdown, with automatic quality checks and retries for stronger crawling when needed.
Instructions
Scrape a public web page into clean markdown in one call: runs a crawler, waits, scores the result (completeness, bot-wall detection), and automatically retries with stronger settings when quality is low. Costs Apify credits per run. For arbitrary actors or fire-and-forget runs use run_actor instead.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public http(s) URL to scrape | |
| max_pages | No | How many pages to crawl starting from the URL (same site) | |
| max_tokens | No | Token budget for the returned page content | |
| quality_retry | No | Re-run with residential proxies / a browser crawler when quality is low |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| pages | Yes | ||
| run_id | Yes | ||
| quality | Yes | ||
| attempts | Yes | ||
| truncated | Yes | ||
| dataset_id | Yes |