Submit an asynchronous batch scrape job.
post_firecrawl_batch_scrapeScrape many URLs as one background job. urls and an Idempotency-Key are required; maxConcurrency, onlyMainContent, includeTags, excludeTags, maxAge, minAge and timeout tune it. Asynchronous. Submitting returns HTTP 202 and a job envelope — id, object, endpoint, status, createdAt, completedAt, pricing, output, error — with output still null. Poll get_firecrawl_batch_scrape_job until terminal; output is then an array of documents with markdown and metadata. Use it when you have a list of URLs and do not need them immediately. When you do need them immediately, post_tavily_extract returns a small batch synchronously in about a second; for a single page post_firecrawl_scrape. Send a fresh Idempotency-Key per distinct batch.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| urls | Yes | 1 to 1000 unique HTTPS URLs to scrape. PDF URLs are not supported. | |
| maxAge | No | Maximum acceptable cache age in milliseconds. | |
| minAge | No | Minimum cache age in milliseconds before a page is refetched. | |
| timeout | No | Per-page timeout in milliseconds. | |
| excludeTags | No | HTML tags/selectors to drop. | |
| includeTags | No | HTML tags/selectors to keep. | |
| maxConcurrency | No | Maximum number of concurrent scrapes (1 to 20). | |
| Idempotency-Key | Yes | Unique key (1 to 191 characters) that makes the submit idempotent. Re-submitting with the same key returns the original job. | |
| onlyMainContent | No | Return only the main content of each page. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||