Crawl the site and audit every page
site_crawlCrawl a website and return a site-level SEO audit covering broken links, redirects, duplicate metadata, missing tags, thin pages, orphan pages, and click depth.
Instructions
Breadth-first crawl from a start URL (same host only, respects robots.txt for Googlebot), auditing each HTML page like page_audit. Returns a site-level summary: status code counts, broken internal links with their referrers, redirect chains, duplicate titles and descriptions, pages missing title/description/H1, noindex pages, thin pages, images without alt, orphan pages (in sitemap but never linked), click depth from the start page and inbound-link counts per page. Use maxPages to bound the run; a 200-page crawl takes 1-3 minutes.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| maxPages | No | ||
| startUrl | Yes | ||
| pathPrefix | No | Only crawl URLs whose path starts with this, e.g. '/blog/'. | |
| concurrency | No | ||
| includePages | No | Include the per-page audit rows in the response (large). | |
| includeSitemap | No | Also read the sitemap to detect orphan pages and seed the queue. |