Web Crawl Async
web_crawl_asyncSubmit a same-host crawl as an asynchronous job and return a job_id immediately. When to use: you need more than a couple of pages and cannot hold a long HTTP request; submit here, then poll web_crawl_job until status is done, failed or cancelled. Do not use: for one page (web_fetch) or when you need the result in this call (web_crawl). Returns: {ok, job_id, status, url, depth, max_pages, max_chars, idempotent, poll_with}. Pass idempotency_key to retry safely (24h window returns the same job). Metered: shares the web free bucket (100 calls/day per IP), then 3 credits per submit over x402.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | Start URL (same host is crawled). | |
| depth | No | Link depth 1-2. Default 2. | |
| max_chars | No | Per-page content cap 200-4000. Default 1000. | |
| max_pages | No | Max pages 1-20. Default 20. | |
| idempotency_key | No | Optional; retries within 24h return the same job. |