A
securityA
licenseA
qualityEnables web content scanning and analysis by fetching, analyzing, and extracting information from web pages using tools like page fetching, link extraction, site crawling, and more.
Last updated -
6
12
MIT License
The Website Downloader Server allows you to download entire websites for offline use. With this server, you can:
Download complete websites recursively with all resources (CSS, images, etc.)
Preserve the original website structure locally
Convert links to work properly in the offline version
Customize recursion depth (defaults to infinite)
Specify output directory for downloads
Restrict downloads to the same domain as the initial URL
Add appropriate file extensions to downloaded files
Works cross-platform on macOS, Linux, and Windows with wget installed
Mentioned as one of the installation methods for wget on Windows, which is a prerequisite for the website downloader.
Mentioned as one of the page requisites that the downloader includes when downloading websites.
Referenced as one of the Linux distributions where wget can be installed via apt-get command.
Referenced as one of the Linux distributions where wget can be installed via dnf command.
Mentioned as the installation method for wget on macOS, which is a prerequisite for the website downloader.
Referenced as one of the operating systems where wget can be installed.
Mentioned as one of the operating systems where wget can be installed as a prerequisite.
Referenced as one of the Linux distributions where wget can be installed via dnf command.
Referenced as one of the Linux distributions where wget can be installed via apt-get command.
Website Downloader MCP Server
This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.
Prerequisites
The server requires wget to be installed on your system.
Installing wget
macOS
Using Homebrew:
brew install wget
Linux (Debian/Ubuntu)
sudo apt-get update
sudo apt-get install wget
Linux (Red Hat/Fedora)
sudo dnf install wget
Windows
Using Chocolatey:
choco install wget
Or download the binary from: https://eternallybored.org/misc/wget/
Download the latest wget.exe
Place it in a directory that's in your PATH (e.g., C:\Windows\System32)
Usage
The server provides a tool called download_website with the following parameters:
url(required): The URL of the website to downloadoutputPath(optional): The directory where the website should be downloaded. Defaults to the current directory.depth(optional): Maximum depth level for recursive downloading. Defaults to infinite. Set to 0 for just the specified page, 1 for direct links, etc.
Example
{
"url": "https://example.com",
"outputPath": "/path/to/output",
"depth": 2 // Optional: Download up to 2 levels deep
}
Features
The website downloader:
Downloads recursively with infinite depth
Includes all page requisites (CSS, images, etc.)
Converts links to work locally
Adds appropriate extensions to files
Restricts downloads to the same domain
Preserves the website structure
Installation
Build the server:
npm install
npm run build
Add to MCP settings:
{
"mcpServers": {
"website-downloader": {
"command": "node",
"args": ["/path/to/website-downloader/build/index.js"]
}
}
}
Related MCP Servers
- AsecurityAlicenseAqualityThis server enables users to download entire websites and their assets for offline access, supporting configurable depth and concurrency settings.Last updated -15MIT License
- AsecurityAlicenseAqualityProvides functionality to fetch web content in various formats, including HTML, JSON, plain text, and Markdown.Last updated -4395641MIT License
- AsecurityFlicenseAqualityProvides functionality to fetch web content in various formats, including HTML, JSON, plain text, and Markdown.Last updated -4113,2632