fetch_website_nested
Crawl websites with nested URL navigation to extract and convert content into clean markdown format for structured data analysis.
Instructions
Fetch website content with nested URL crawling and convert to clean markdown
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| url | Yes | The starting URL to fetch and crawl | |
| maxDepth | No | Maximum depth to crawl (default: 2) | |
| maxPages | No | Maximum number of pages to fetch (default: 50) | |
| sameDomainOnly | No | Only crawl URLs from the same domain (default: true) | |
| excludePatterns | No | Regex patterns for URLs to exclude | |
| includePatterns | No | Regex patterns for URLs to include (if specified, only matching URLs will be processed) | |
| timeout | No | Request timeout in milliseconds (default: 10000) |