fire_crawl_map

fire_crawl_map

Discover URLs from a starting point. Can use both sitemap.xml and HTML link discovery.

Input Schema

Name	Required	Description
`ignoreSitemap`	No	Skip sitemap.xml discovery and only use HTML links
`includeSubdomains`	No	Include URLs from subdomains in results
`limit`	No	Maximum number of URLs to return
`search`	No	Optional search term to filter URLs
`sitemapOnly`	No	Only use sitemap.xml for discovery, ignore HTML links
`url`	Yes	Starting URL for URL discovery

Input Schema (JSON Schema)

{
  "properties": {
    "ignoreSitemap": {
      "description": "Skip sitemap.xml discovery and only use HTML links",
      "type": "boolean"
    },
    "includeSubdomains": {
      "description": "Include URLs from subdomains in results",
      "type": "boolean"
    },
    "limit": {
      "description": "Maximum number of URLs to return",
      "type": "number"
    },
    "search": {
      "description": "Optional search term to filter URLs",
      "type": "string"
    },
    "sitemapOnly": {
      "description": "Only use sitemap.xml for discovery, ignore HTML links",
      "type": "boolean"
    },
    "url": {
      "description": "Starting URL for URL discovery",
      "type": "string"
    }
  },
  "required": [
    "url"
  ],
  "type": "object"
}

Input Schema

Input Schema (JSON Schema)

Other Tools