scrape_websites
Scrape multiple websites to collect LLM pricing data in markdown or HTML format, returning successfully processed sources for further analysis.
Instructions
Scrape multiple websites using Firecrawl and store their content.
Args: websites: Dictionary of provider_name -> URL mappings formats: List of formats to scrape ['markdown', 'html'] (default: both) api_key: Firecrawl API key (if None, expects environment variable)
Returns: List of provider names for successfully scraped websites
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| api_key | No | ||
| formats | No | ||
| websites | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |