Website Downloader

🚀 Website Downloader MCP Server

This MCP server provides a tool to download an entire website using wget. It preserves the website structure and converts links to work locally.

🚀 Quick Start

Prerequisites

This server requires wget to be installed on the system.

Installing wget

macOS

Use Homebrew:

brew install wget

Linux (Debian/Ubuntu)

sudo apt-get update
sudo apt-get install wget

Linux (Red Hat/Fedora)

sudo dnf install wget

Windows

1. Use Chocolatey:

choco install wget

2. Or download the binary from the following link: https://eternallybored.org/misc/wget/
   • Download the latest version of wget.exe
   • Place it in a directory included in the PATH environment variable (e.g., C:\Windows\System32)

💻 Usage Examples

Basic Usage

The server provides a tool named download_website with the following parameters:

• url (Required): The URL of the website to download.
• outputPath (Optional): The target directory for the downloaded website. Defaults to the current directory.
• depth (Optional): The maximum depth level for recursive downloads. Defaults to infinite. Setting it to 0 means only downloading the specified page, 1 means direct links, etc.

Example

{
  "url": "https://example.com",
  "outputPath": "/path/to/output",
  "depth": 2  // Optional: Download up to 2 levels deep
}

✨ Features

The website downloader:

• Downloads recursively with infinite depth by default.
• Includes all page resources (CSS, images, etc.).
• Converts links to work locally.
• Adds appropriate file extensions.
• Restricts downloads to content under the same domain.
• Preserves the website structure.

📦 Installation

1. Build the server:

npm install
npm run build

2. Add to MCP settings:

{
  "mcpServers": {
    "website-downloader": {
      "command": "node",
      "args": ["/path/to/website-downloader/build/index.js"]
    }
  }
}