dompruner_sitemap
Fetches every page in a sitemap.xml and converts it to compact Markdown, reducing tokens by 90%+ for LLM ingestion. Handles nested sitemap indexes automatically.
Instructions
Fetches all pages listed in a sitemap.xml and returns DOM-pruned Markdown for each. Ideal for ingesting entire documentation sites into an LLM context with 90%+ token reduction. Handles sitemap indexes (sitemaps of sitemaps) automatically. Use filter_urls to limit to a path prefix (e.g. /docs/, /tutorial/).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| query | No | Optional BM25 filter query applied to every page. | |
| max_pages | No | Max pages to fetch (default 20, max 100). Guards against huge sitemaps. | |
| concurrency | No | Max simultaneous page fetches (default 8). | |
| filter_urls | No | Optional list of URL prefixes — only pages matching at least one prefix are included. | |
| sitemap_url | Yes | URL of the sitemap.xml (e.g. https://example.com/sitemap.xml) | |
| ignore_errors | No | If true (default), failed page fetches are skipped silently. If false, any fetch error aborts the entire sitemap crawl. |