scrape_url
Read-only
Scrape any web page: get clean Markdown, rendered/raw HTML, all links, SEO metadata, and/or a full-page screenshot in a single call. Costs 1 scraping credit per successful request regardless of how many formats you ask for. Screenshots use a full Chromium render (~5-15s); other formats are faster (~1-5s). Screenshots are returned as an image attachment. Use for reading article content, extracting page metadata, link discovery, or visual captures.
Input Schema
TableJSON Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Full URL to scrape. Must start with http:// or https://. | |
| formats | No | Output formats to return. Default ["markdown", "metadata"]. | |
| timeout | No | Maximum milliseconds for the entire scrape. Default 30000. | |
| waitFor | No | Extra milliseconds to wait after page load (for lazy-loaded content). Default 0. | |
| onlyMainContent | No | Strip navigation/footer/ads, keeping only the main article content. Default true. |