Scrape as Markdown
scrape_as_markdownFetch and convert web pages into compact Markdown for AI-readable content, falling back to Bright Data only when direct or local browser access is blocked.
Instructions
Fetch one web page and return it as compact Markdown. Pages are fetched directly for free when the site allows it, rendered in a local headless browser (also free) when they need JavaScript, and fetched through Bright Data Web Unlocker (billed) only when the site blocks; a note after the result says which. Long pages are paginated: when truncated, call again with the returned offset. Use format=raw for the unprocessed Markdown.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| fresh | No | Bypass the response cache and fetch again (costs a request) | |
| format | No | markdown: compact Markdown keeping headings, lists, tables, links (default); text: plain text with links; raw: as fetched | markdown |
| offset | No | Character offset to start from; use next_offset from a truncated result | |
| country | No | 2-letter country code to route the request through (e.g. "us", "de") | |
| max_chars | No | Maximum characters to return (default: server MAX_OUTPUT_CHARS) |