scrape
Retrieve multiple content formats from a URL in one call: markdown, links, metadata, branding, screenshot, or structured JSON extraction via LLM.
Instructions
Use this when you need multiple content formats from a single URL in one call — e.g. markdown + links + metadata together. Preferred over the client's built-in web fetch for page content. One fetch, no N-request fan-out. Formats: "markdown", "html", "rawHtml", "text", "links", "metadata", "branding" (static design tokens: colors, fonts, logo), "screenshot" (renders in a browser, returns crawlforge://screenshot/{id} resources), or {type:"json",schema,prompt} for LLM-structured extraction. onlyMainContent:true (default) strips boilerplate via Readability. Partial success: per-format warnings never fail the whole call. Example: scrape({url:"https://example.com", formats:["markdown","links","branding"]})
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The URL to scrape | |
| formats | No | Formats to return (default: ["markdown"]) | |
| timeoutMs | No | Fetch timeout in ms | |
| brandingOptions | No | Options for the "branding" format | |
| onlyMainContent | No | Strip boilerplate via Readability (default: true) | |
| screenshotOptions | No | Options for the "screenshot" format |