firecrawl_map
Discover all indexed URLs on a website to identify pages for scraping or locate specific sections before content extraction.
Instructions
Map a website to discover all indexed URLs on the site.
Best for: Discovering URLs on a website before deciding what to scrape; finding specific sections of a website. Not recommended for: When you already know which specific URL you need (use scrape or batch_scrape); when you need the content of the pages (use scrape after mapping). Common mistakes: Using crawl to discover URLs instead of map. Prompt Example: "List all URLs on example.com." Usage Example:
{
"name": "firecrawl_map",
"arguments": {
"url": "https://example.com"
}
}
Returns: Array of URLs found on the site.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| ignoreSitemap | No | Skip sitemap.xml discovery and only use HTML links | |
| includeSubdomains | No | Include URLs from subdomains in results | |
| limit | No | Maximum number of URLs to return | |
| search | No | Optional search term to filter URLs | |
| sitemapOnly | No | Only use sitemap.xml for discovery, ignore HTML links | |
| url | Yes | Starting URL for URL discovery |
Input Schema (JSON Schema)
{
"properties": {
"ignoreSitemap": {
"description": "Skip sitemap.xml discovery and only use HTML links",
"type": "boolean"
},
"includeSubdomains": {
"description": "Include URLs from subdomains in results",
"type": "boolean"
},
"limit": {
"description": "Maximum number of URLs to return",
"type": "number"
},
"search": {
"description": "Optional search term to filter URLs",
"type": "string"
},
"sitemapOnly": {
"description": "Only use sitemap.xml for discovery, ignore HTML links",
"type": "boolean"
},
"url": {
"description": "Starting URL for URL discovery",
"type": "string"
}
},
"required": [
"url"
],
"type": "object"
}