Crawl web pages
web_crawl_runCrawl a small set of web pages synchronously. Accepts a URLs. Returns a list (use cursor when paginated).
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | No | URLs to crawl. Repeat the `url` query parameter for multiple pages (max 5). | |
| waitFor | No | Wait for a CSS selector before extraction. Must be prefixed with "css:" (e.g. css:main). JavaScript wait conditions are not supported. | |
| scanFullPage | No | When true, scroll the page to load dynamically appended content (infinite scroll). Default false. |