fetch_website_nested

Crawl nested URLs from a starting webpage, fetch content, and convert it into structured markdown. Control depth, page limits, domain scope, and URL inclusion/exclusion for precise content extraction.

Instructions

Fetch website content with nested URL crawling and convert to clean markdown

Input Schema

Name	Required	Description
`excludePatterns`	No	Regex patterns for URLs to exclude
`includePatterns`	No	Regex patterns for URLs to include (if specified, only matching URLs will be processed)
`maxDepth`	No	Maximum depth to crawl (default: 2)
`maxPages`	No	Maximum number of pages to fetch (default: 50)
`sameDomainOnly`	No	Only crawl URLs from the same domain (default: true)
`timeout`	No	Request timeout in milliseconds (default: 10000)
`url`	Yes	The starting URL to fetch and crawl

Input Schema (JSON Schema)

{
  "properties": {
    "excludePatterns": {
      "description": "Regex patterns for URLs to exclude",
      "items": {
        "type": "string"
      },
      "type": "array"
    },
    "includePatterns": {
      "description": "Regex patterns for URLs to include (if specified, only matching URLs will be processed)",
      "items": {
        "type": "string"
      },
      "type": "array"
    },
    "maxDepth": {
      "default": 2,
      "description": "Maximum depth to crawl (default: 2)",
      "type": "number"
    },
    "maxPages": {
      "default": 50,
      "description": "Maximum number of pages to fetch (default: 50)",
      "type": "number"
    },
    "sameDomainOnly": {
      "default": true,
      "description": "Only crawl URLs from the same domain (default: true)",
      "type": "boolean"
    },
    "timeout": {
      "default": 10000,
      "description": "Request timeout in milliseconds (default: 10000)",
      "type": "number"
    },
    "url": {
      "description": "The starting URL to fetch and crawl",
      "type": "string"
    }
  },
  "required": [
    "url"
  ],
  "type": "object"
}

Better Fetch

fetch_website_nested

Instructions

Input Schema

Input Schema (JSON Schema)

Other Tools from Better Fetch

Related Tools

MCP directory API