flycrawl_map
Map a domain's internal URLs and sitemap hierarchy quickly. Returns only discovered URLs, ideal for reconnaissance before scraping.
Instructions
Quickly discover and list all reachable internal URLs and sitemap hierarchy on a domain in under 2 seconds.
BEHAVIOR & SAFETY: Read-only and non-destructive. Queries sitemaps, robots.txt, and top-level link graphs. AUTHENTICATION: Requires valid FLYCRAWL_API_KEY. RATE LIMITS & BILLING: Consumes 1 credit per domain mapping operation. DYNAMIC JS RENDERING: Headless DOM parsing for dynamically injected single-page application router links. DIFFERENCE FROM flycrawl_crawl: flycrawl_map returns only a list of discovered URLs (no content bodies), making it ideal for reconnaissance before targeted scraping. ERROR HANDLING: Returns discovered URLs or structured error JSON.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The target website domain to map (e.g. 'https://stripe.com'). | |
| limit | No | Maximum URLs to return (default: 1000). | |
| search | No | Optional keyword to filter discovered URLs. |