MCP Npx Fetch

🚀 MCP NPX Fetch

A powerful MCP server for easily scraping and converting web content into various formats (HTML, JSON, Markdown, plain text).

✨ Features

• 🌐 Universal Content Scraping: Supports HTML, JSON, plain text, and Markdown formats.
• 🔒 Custom Header Support: Allows adding authentication and custom request headers.
• 🛠 Built-in Conversion Tools: Provides HTML-to-Markdown conversion functionality.
• 💡 Type Safety: Implements strict type checking using TypeScript and Zod.
• 📈 Efficient Processing: Supports fast parsing and processing of large files.

📦 Installation

Global Installation

npm install -g @tokenizin/mcp-npx-fetch

Direct Usage

npx mcp-npx-fetch

📚 Documentation

Available Tools

1. mcp-npx-fetch

Parameter Description

Example Usage

mcp-npx-fetch --input "https://example.com" --output "./result.md"

2. html-to-md

Function Description

Converts HTML content to Markdown format.

Usage Example

mcp-npx-html-to-md --input "./index.html" --output "./document.md"

💻 Usage Examples

CLI Usage

Run the following command directly in the terminal:

mcp-npx-fetch --help

Claude Desktop Integration

1. Open the settings.json file.
2. Add the following configuration:

{
  "mcp-npx_FETCH": {
    "path": "node_modules/@tokenizin/mcp-npx-fetch/dist/index.js",
    "args": []
  }
}

3. Use the plugin in your project.

🔧 Technical Details

Local Development

1. Clone the repository:

git clone https://github.com/tokenizin-agency/mcp-npx-fetch.git
cd mcp-npx-fetch

2. Install dependencies:

npm install

3. Start the development server:

npm run dev

Technology Stack

• JSDOM: Used for parsing and manipulating HTML documents.
• Turndown: Provides HTML-to-Markdown conversion functionality.
• TypeScript: Implements a type-safe code structure.
• Zod: Used for strict type validation and data processing.

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request. For major changes, please open an issue first to discuss what you would like to change.

1. Fork the repository.
2. Create a feature branch (git checkout -b feature/AmazingFeature).
3. Commit your changes (git commit -m 'Add some AmazingFeature').
4. Push to the branch (git push origin feature/AmazingFeature).
5. Open a Pull Request.

📄 License

This project is licensed under the MIT License. See the LICENSE file for details.