crawl
Extract website content by crawling from a specified URL, limiting depth and page count. Outputs data in markdown and HTML for analysis or processing.
Instructions
Crawls a website starting from the specified URL and extracts content from multiple pages. Args: - url: The complete URL of the web page to start crawling from - maxDepth: The maximum depth level for crawling linked pages - limit: The maximum number of pages to crawl
Input Schema
Name | Required | Description | Default |
---|---|---|---|
limit | Yes | ||
maxDepth | Yes | ||
url | Yes |