Context.dev — Crawl Sitemap
context_dev_get_v1_web_scrape_sitemapDiscover every URL in a website's sitemap. Uses the caller's OpenAny gateway credentials. Charges and authorization are determined by the gateway.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| zdr | No | `enabled` turns on zero data retention. Returns 403 `ZDR_NOT_ENABLED` unless your organization has ZDR. | |
| domain | Yes | Domain to map, e.g. `stripe.com`. | |
| search | No | Filter URLs by a topic or phrase, most relevant first. | |
| maxLinks | No | Maximum number of URLs to return. | |
| urlRegex | No | Regex pattern. Only URLs matching this pattern are returned and counted against maxLinks. | |
| sitemapUrl | No | Fetch this sitemap instead of discovering sitemaps. Must belong to the domain or a subdomain. | |
| excludeUrlRegex | No | Regex pattern. URLs matching this pattern are not returned, even when they match urlRegex. | |
| includeSubdomains | No | Include URLs on subdomains. |