web_map
Every url of a site, fast and cheap: its sitemap plus, optionally, the links on the page. Use it BEFORE crawling, to see what is there and decide what is worth reading. 1 credit ($0.002) with includePage: false (no browser at all), 1.5 credits ($0.003) with the page. Reference for the oassis API: https://oassis.dev/openapi.json
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Page to process. | |
| limit | No | Urls to return. Up to 5000. | |
| search | No | Keep only urls containing this text. | |
| includePage | No | Render the page too, to catch urls the sitemap does not list. `false` uses no browser at all, so it costs less: $0.002 against $0.003. | |
| excludePaths | No | Discard urls whose path contains one of these. Up to twenty. It wins over `includePaths`. | |
| includePaths | No | Keep only urls whose path contains one of these. Up to twenty. | |
| includeSubdomains | No | Treat subdomains of the same site as part of it. |