invoke_firecrawl_llmtxt
Crawl websites to generate structured LLM-ready markdown files using Firecrawl, extracting data for AI inference and storing results in S3.
Instructions
Start an asynchronous llmfull.txt generation job using Firecrawl. This file is a standardized markdown file containing information to help LLMs use a website at inference time. The llmstxt endpoint leverages Firecrawl to crawl your website and extracts data using gpt-4o-mini Args: url: URL to crawl s3_uri: S3 URI where results will be uploaded max_urls: Maximum number of pages to crawl (1-100, default: 10)
Returns:
Dictionary with job information including the job IDInput Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| s3_uri | Yes | ||
| max_urls | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |