scan_domain
Crawl any domain to discover all SEO-relevant page URLs. Use it to find pages for further SEO analysis.
Instructions
Crawl a domain and return all SEO-relevant page URLs. Use this to discover pages before running analysis.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| domain | Yes | Domain or URL to scan (e.g. 'example.com' or 'https://example.com') | |
| maxPages | No | Maximum pages to crawl (server default applies; capped at the batch analysis limit) | |
| excludePatterns | No | URL patterns to exclude from crawling | |
| respectRobotsTxt | No | Whether to respect robots.txt (default: true) | |
| defaultLanguageOnly | No | Only return pages in the site's default language (default: true) |