flycrawl_scrape
Convert any webpage into clean, LLM-ready Markdown or HTML. Bypass JavaScript and Cloudflare challenges to extract main content.
Instructions
Scrapes any webpage into clean, LLM-optimized markdown or HTML. Handles JavaScript, anti-bot challenges (Cloudflare), and extracts main content.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The complete URL of the webpage to scrape. | |
| onlyMainContent | No | Whether to strip navigation, headers, footers, and ads (default: true). |