crawl_website
Extract text content from websites by crawling pages, with support for static and JavaScript-rendered sites. Specify URL, max pages, and crawler type to get structured JSON results.
Instructions
Crawl a website and extract page content by running the apify/website-content-crawler actor. Returns a fixed-shape envelope: {status, run:{id,status}, page_count, pages:[{url,title,text}]}. Requires APIFY_TOKEN in the environment.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to crawl (http/https) | |
| maxPages | No | Maximum pages to crawl, capped at 50 (default 10) | |
| crawlerType | No | cheerio = fast/static and cheaper; playwright:chrome = JS-rendered sites (default cheerio) |