web_map
Every url of a site, fast and cheap: its sitemap plus, optionally, the links on the page. Use it BEFORE crawling, to see what is there and decide what is worth reading. $0.0003 with includePage: false (no browser at all), $0.0015 with the page.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The site to map. | |
| limit | No | Urls to return (default 1000, max 5000). | |
| search | No | Keep only urls containing this text. | |
| includePage | No | Render the page too (default true). | |
| excludePaths | No | ||
| includePaths | No | ||
| includeSubdomains | No |