map
Discover all reachable URLs on a site by following links up to a set depth. Returns internal and external link counts, supports keyword filters, SPAs, and per-level limits.
Instructions
Discover all reachable URLs under a given site. Useful for understanding a domain's structure before crawling, or finding the sub-pages an agent should scrape. Returns lists of internal links, external links, and counts. Honors depth and limit parameters.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The starting URL for discovery (typically a homepage or section root). | |
| depth | No | How many link-hops from the starting URL to follow. | |
| limit | No | Maximum number of URLs to return overall. | |
| search | No | Optional keyword filter — only return URLs whose path/title matches. | |
| useBrowser | No | Render with a headless browser (for SPAs). | |
| limitPerLevel | No | Maximum URLs collected per depth level (controls breadth). | |
| includeSubdomains | No | Include URLs on subdomains of the starting host. | |
| includeExternalLinks | No | Also collect (but do not follow) external links. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| links | Yes | ||
| durationMs | Yes | ||
| totalLinks | Yes | ||
| externalLinks | Yes | ||
| totalExternalLinks | Yes |