Crawl Web Page (Legacy)
web-crawlCrawl a public URL and return its content as plain text or HTML. Use for legacy /web/crawl route parity; prefer extract for new integrations.
Instructions
Crawl a public URL and return its content as plain text or HTML on the legacy Desearch /web/crawl route. The SDK marks webCrawl deprecated in favor of extract; this tool stays for parity with that route. Prefer extract for new integrations.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| js | No | Render JavaScript before reading the page. | |
| url | Yes | Public URL to read, example: 'https://desearch.ai' | |
| wait | No | Post-load wait in milliseconds when JavaScript rendering is enabled. | |
| format | No | Content format to return: 'html' or 'text'. |