Crawl a website into the knowledge base
start_crawlCrawl a website to add its pages to the knowledge base. Runs in background, with page count capped by your plan.
Instructions
Crawl a website and add its pages to the knowledge base. Runs in the background; check on it with list_crawls. Each plan caps the pages per crawl, and asking for more than the cap is refused.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| max_pages | No | How many pages to take at most. Capped by the plan. | |
| start_url | No | Where to start. Defaults to the website's own domain. | |
| website_id | No | Numeric id of the website, from list_websites. Omit to use the account's primary website. |