sitemap_urls
List page URLs from competitor sitemaps to map content structure. Discovers sitemaps via robots.txt or /sitemap.xml, follows indexes, and supports filtering by substring.
Instructions
List page URLs from a competitor's sitemaps to map its content structure.
Discovers sitemaps via robots.txt (falls back to /sitemap.xml), follows sitemap indexes recursively and reads gzipped sitemaps.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| site | Yes | Domain or URL, e.g. example.com | |
| limit | No | ||
| contains | No | Keep only URLs containing this substring |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| site | Yes | ||
| urls | Yes | ||
| sitemaps | Yes | Sitemap files that were read | |
| total_found | Yes | Matching URLs found before the limit was applied |