crawl
Start a background web-page scan with configurable strategy, workers, depth, domain, path filters, and query coverage; returns a job ID for status tracking.
Instructions
Start crawling a site in the background (strategy bfs, dfs or best_first; workers pages at once). By default only pages under the start address; entire_domain for the whole site. With a query it stops once the pages cover it. Returns a job id for crawl_status.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"url": "<url>"
},
"name": "crawl"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | ||
| limit | No | ||
| query | No | ||
| formats | No | ||
| workers | No | ||
| strategy | No | bfs | |
| max_depth | No | ||
| entire_domain | No | ||
| exclude_paths | No | ||
| include_paths | No |