edf_crawl_site
Start a bounded crawl of a public website or sitemap to discover external hostnames, optionally check them, and return a job ID for polling.
Instructions
Start a bounded EDF crawl of one public website or sitemap, discover external hostnames, and optionally check them. Same-origin page queue, at most 500 pages/1000 domains. Returns job ID; poll edf_get_job. Native regex crawler does not render JavaScript.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| mode | No | site | |
| delay_ms | No | ||
| max_pages | No | ||
| max_domains | No | ||
| check_domains | No |