scrape
Convert a single webpage into LLM-ready markdown using adaptive fetch modes: fast HTTP, stealth Chromium with Cloudflare bypass, or full browser with BM25 content extraction.
Instructions
Scrape a single URL → LLM-ready markdown.
Args:
url: Target URL (http/https/file/raw:).
prefer: "auto" | "fast" | "stealth" | "llm".
auto = fast first, escalate to stealth on block/short page.
fast = cheap HTTP only (no JS).
stealth = real Chromium + Cloudflare solver.
llm = full Crawl4AI browser + BM25 fit-markdown.
timeout: per-attempt timeout in seconds.
include_html: include raw HTML in the response (large; off by default).
js: (stealth only) JS expression evaluated against the live page
after it settles. The value comes back in meta.js_result.
Use for data that lives in DOM properties (e.g. an input's
.value) rather than in serialized HTML.
wait_for: (stealth only) JS predicate expression polled until truthy
(bounded by timeout). Use to wait for content that arrives
asynchronously after network_idle.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| js | No | ||
| url | Yes | ||
| prefer | No | auto | |
| timeout | No | ||
| wait_for | No | ||
| include_html | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||