web_scrape
Fetch a public URL and extract clean content as markdown, HTML, links, or metadata. Automatically handles JavaScript-rendered pages.
Instructions
Scrape a URL into markdown, HTML, links or metadata. Fetches a single public URL and returns clean content in the requested formats (markdown, html, raw_html, links, metadata). With render=auto the request starts as a fast HTTP fetch and escalates to a real browser when the page is blocked or rendered with JavaScript. only_main_content (default true) strips navigation, headers, footers and other boilerplate before conversion. Only public pages are supported; respect each site's terms of use and robots directives.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| scrapeOption | Yes | Scrape options |