Fetch URL
fetch_urlRead public URLs as markdown, including PDFs, with options to return relevant passages or specific page sections for research and extraction.
Instructions
Read public URLs as markdown (PDFs included). GitHub files/repos/releases come from the GitHub API; YouTube and Reddit have fast paths; other pages go Crawl4AI (headless browser) then raw HTTP. Returns a window of the page with a footer saying how to continue; query or find return passages instead. Cached 24h.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | http(s) URL, or up to 5 URLs read in parallel | |
| find | No | Return passages around literal case-insensitive matches; '|' separates alternatives | |
| fresh | No | Bypass the cache for this call (search 1h, pages 24h) | |
| query | No | Return the page's 5 passages most relevant to this question (local reranker) instead of the page head | |
| offset | No | Character offset to start from, as given in the footer | |
| max_tokens | No | Approx tokens to return per page (default 2000; 1000 each when several URLs) | |
| domain_profile | No | Domain profile: boosts and blocks a set of sites | |
| target_selector | No | CSS selector to scope extraction, e.g. 'article' | |
| wait_for_selector | No | CSS selector to wait for on JS-rendered pages |