Crawl Site
crawl_siteRead multiple linked pages with strict page and depth limits.
Use only when several pages are required. If you merely need to discover a site's structure, use map_site first because crawling is slower and costlier.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Absolute HTTP(S) starting URL for a bounded multi-page crawl | |
| max_depth | No | Maximum link depth from the starting URL (capped at 5) | |
| max_pages | No | Maximum pages to read (capped at 50) |