firecrawl_crawl
Crawl a website from a starting URL, returning content from multiple pages. Control crawl with include/exclude patterns, depth, and page limits.
Instructions
Crawl a website starting from a URL and return content from multiple pages
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The starting URL to crawl | |
| includes | No | URL patterns to include (supports wildcards) | |
| excludes | No | URL patterns to exclude (supports wildcards) | |
| maxDepth | No | Maximum crawl depth | |
| limit | No | Maximum number of pages to crawl | |
| allowBackwardLinks | No | Allow crawling backward links | |
| allowExternalLinks | No | Allow crawling external links |