Discover the public URLs of a site when you need to know which pages exist before fetching any of them — scoping a crawl, auditing coverage, or locating a section. With the default type: "sitemap" this reads the site's own sitemap: Sitemap: directives in robots.txt first, then the conventional paths, following sitemap index files and gzipped sitemaps, and returns the URLs it declares for the requested host. A site that publishes no sitemap falls back to the links found on the given page. Use type: "all" to skip the sitemap and get every link on that one page instead, including links to o Uses the caller's OpenAny gateway credentials. Charges and authorization are determined by the gateway.