map_site
Enumerate all internal URLs reachable from a root URL to map site structure and discover pages before crawling. Use include_pattern and limit to filter results.
Instructions
Enumerate all internal URLs reachable from root.
Use when the user wants to map a site's structure or find all pages
before crawling. Often paired with crawl or batch_scrape.
Args: root: Website root (e.g. "https://example.com/docs"). include_pattern: Optional regex; only URLs matching are returned. limit: Hard cap on returned URLs.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| root | Yes | ||
| limit | No | ||
| include_pattern | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||