x402_scrape_url
Extract structured data from web pages including markdown content, links, tables, images, and metadata. Supports JavaScript-rendered pages with optional CSS selector waiting for dynamic content.
Instructions
Scrape a web page and return structured JSON with markdown content, links, tables, images, and metadata. Price: $0.02 USDC per scrape (paid mode) | Free test: returns fixture data.
Supports JS-rendered pages via Playwright. Optional wait_for CSS selector for async SPA content. Hard timeout: 8 seconds total (page load + selector wait combined). Without X402_PRIVATE_KEY, only the free test endpoint is available.
Returns: markdown text, extracted links, tables, images, page metadata, and success/failure status.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | URL to scrape (http/https, max 2048 chars) | |
| wait_for | No | CSS selector to wait for before extracting (for SPAs, e.g. '.article-body') |