scrape_websites
Scrape multiple websites via Firecrawl to capture pricing content for cost comparison. Map provider names to URLs, choose markdown or HTML formats, and get the list of successfully scraped providers.
Instructions
Scrape multiple websites using Firecrawl and store their content.
Args: websites: Dictionary of provider_name -> URL mappings formats: List of formats to scrape ['markdown', 'html'] (default: both) api_key: Firecrawl API key (if None, expects environment variable)
Returns: List of provider names for successfully scraped websites
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| api_key | No | ||
| formats | No | ||
| websites | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |