tavily_map
Map a website's structure by crawling from a root URL to find all internal and external links. Control crawl depth, breadth, and navigation rules.
Instructions
Map a website's structure. Returns a list of URLs found starting from the base URL.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The root URL to begin the mapping | |
| limit | No | Total number of links the crawler will process before stopping | |
| max_depth | No | Max depth of the mapping. Defines how far from the base URL the crawler can explore | |
| max_breadth | No | Max number of links to follow per level of the tree (i.e., per page) | |
| instructions | No | Natural language instructions for the crawler | |
| select_paths | No | Regex patterns to select only URLs with specific path patterns (e.g., /docs/.*, /api/v1.*) | |
| allow_external | No | Whether to return external links in the final response | |
| select_domains | No | Regex patterns to restrict crawling to specific domains or subdomains (e.g., ^docs\.example\.com$) |