Discover sitemap URLs
gvt_get_sitemap_urlsDiscovers and ranks URLs from a domain's XML sitemaps. Use this tool to find the most significant pages on a website (e.g., homepages, product pages, recently updated content) before analyzing them. Supports filtering by URL patterns and automatically flags pages blocked by robots.txt or already tested. Returns a ranked list of URLs optimized for SEO importance. Legal/policy boilerplate pages (privacy, terms, cookies, disclaimers, refund policies, etc) are flagged with legalPage:true and carry a -25 significance penalty; use the legalPages filter to drop them (exclude) or isolate them for a policy-coverage audit (only).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The target website URL or an explicit sitemap .xml URL. | |
| sort | No | How to sort the discovered URLs. 'significance' uses SEO heuristics. | significance |
| limit | No | Maximum number of URLs to return (default 10). | |
| exclude | No | Wildcard patterns to reject (e.g., '*archive*'). | |
| include | No | Wildcard patterns to require (e.g., '*blog*'). Only '*' wildcards are supported. | |
| legalPages | No | Tri-state filter for legal/policy boilerplate pages (privacy, terms, cookies, disclaimers, refund policies, etc). "include" keeps them (default), "exclude" drops them, and "only" returns just the legal/policy pages — useful for auditing a site's policy coverage. | include |
| excludeTested | No | If true, omits URLs the user has already tested. | |
| excludeScheduled | No | If true, omits URLs currently in the testing queue. | |
| excludeDisallowed | No | If true, silently drops URLs that are blocked by robots.txt. |