flycrawl_extract
Extract validated structured JSON from live webpages using natural-language prompts and an optional JSON Schema, with JavaScript rendering and anti-bot handling.
Instructions
Extract typed, structured JSON entities from any live webpage using natural language guidance and an optional JSON Schema.
BEHAVIOR & SAFETY: Read-only and idempotent. Makes no modifications to target servers. Safe for autonomous agents. AUTHENTICATION: Requires valid FLYCRAWL_API_KEY environment variable. RATE LIMITS & BILLING: Costs 1 credit per successful extraction. Fair billing guarantee: 0 credits are deducted if the target page fails to load, times out, or returns a 5xx error. DYNAMIC JS & HEADLESS BROWSING: Automatically executes dynamic client-side JavaScript (SPAs, React, Vue, Angular) and bypasses anti-bot systems (Cloudflare Turnstile, DataDome, Akamai) using stealth residential IP pools. DIFFERENCE FROM flycrawl_scrape: Unlike flycrawl_scrape (which returns the whole page converted to cleaned Fit-Markdown), flycrawl_extract uses an LLM to parse and transform the DOM into a validated JSON schema. ERROR HANDLING: Returns { 'isError': true, 'code': '<HTTP_STATUS>', 'error': '' } on network failure, timeout, or schema mismatch without raising unhandled exceptions.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Target URL to extract data from (must start with http:// or https://). | |
| prompt | Yes | Natural language instructions describing what specific data fields to extract. | |
| schema | No | Optional JSON Schema definition for the extraction structure. |