flycrawl_scrape
Scrape a single webpage into clean, LLM-ready Markdown, JSON, or links for AI ingestion, with dynamic JavaScript rendering and low-token output.
Instructions
Scrape a single webpage and convert it into clean, noise-free, LLM-ready Fit-Markdown, JSON, or links with 90%+ token reduction.
BEHAVIOR & SAFETY: Read-only and idempotent. Makes no modifications to target servers. AUTHENTICATION: Requires valid FLYCRAWL_API_KEY (claim 100 free credits at https://flycrawl.net). RATE LIMITS & BILLING: Consumes 1 credit per successful page scrape. Fair billing guarantee: 0 credits are deducted if the target site returns 4xx/5xx errors or network timeouts. DYNAMIC JS RENDERING: Automatically executes dynamic client-side JavaScript (SPAs, React, Vue, Angular) and bypasses anti-bot systems (Cloudflare Turnstile, DataDome) using stealth residential IP pools. DIFFERENCE FROM flycrawl_extract: flycrawl_scrape extracts the complete readable text and layout of the page as Markdown. Use flycrawl_extract when you need specific JSON fields conforming to a schema. ERROR HANDLING: Returns structured error message with status code on failure without raising unhandled exceptions.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The complete URL of the webpage to scrape (must start with http:// or https://). | |
| format | No | Target output format ('markdown', 'json', 'links', 'summary', 'html'). Default: markdown. | markdown |
| maxAge | No | Cache TTL in seconds (default 86400 = 24h). Cached requests are instant and cost 0 credits. | |
| onlyMainContent | No | Whether to strip navigation, headers, footers, and ads (default: true). |