sitemap_robots_doctor
Audit a website's robots.txt and XML sitemaps in one call: user-agent groups and blocked paths, sitemap declarations, whether each sitemap loads, URL counts (indexes followed to 10 files), lastmod coverage and age, duplicates, off-host and non-HTTPS URLs, size-limit breaches, and a sample of listed URLs checked for status. Returns a list of concrete issues.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| site | Yes | Domain or URL of the site, for example example.com or https://example.com/blog. | |
| sampleUrls | No | How many listed URLs to fetch and check for status (0 to skip). |