crawl-site
Scan and extract all URLs from a website by specifying the target URL and crawl depth, enabling comprehensive web content analysis.
Instructions
Crawl a website and return a list of all the URLs found
Input Schema
Name | Required | Description | Default |
---|---|---|---|
maxDepth | No | ||
url | Yes |