ContextFetch site crawl
contextfetch_crawlCrawl one website from a start URL and get its pages as Markdown: same-site links only, up to max_depth hops (<= 3) and limit pages (<= 50). Pass query to rank the pages by relevance and return only their relevant passages. Costs 1 credit per page returned.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Public http(s) start URL. | |
| limit | No | Maximum pages to return (1-50, default 10). | |
| query | No | Optional topic: ranks pages and prunes each to the relevant passages. | |
| max_depth | No | Link hops from the start page (0-3, default 1). | |
| exclude_paths | No | Regexes; never follow links whose path matches one. | |
| include_paths | No | Regexes; only follow links whose path matches one, e.g. ["^/docs/"]. |