Tanevanwifferen Usescraper MCP Server

🚀 UseScraper MCP Server

A TypeScript-based MCP server that provides web scraping functionality using the UseScraper API. It exposes a single tool named 'scrape' that can extract web page content and supports multiple formats.

🚀 Quick Start

This is a TypeScript-based MCP server offering web scraping capabilities via the UseScraper API. It exposes a single tool named 'scrape' to extract web page content in various formats.

✨ Features

Tools

• scrape - Extract content from web pages
  • Parameters:
    • url (Required): The address of the web page to scrape.
    • format (Optional): The format to save the content (text, html, markdown). Default: markdown.
    • advanced_proxy (Optional): Use an advanced proxy to bypass anti-scraping detection. Default: false.
    • extract_object (Optional): Specify the object of the data to be extracted.

📦 Installation

1. Clone the repository:

   git clone https://github.com/your-repo/usescraper-server.git
   cd usescraper-server
   

2. Install dependencies:

   npm install
   

3. Build the server:

   npm run build
   

📚 Documentation

Configuration

To use it with Claude Desktop, add the following configuration:

On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json
On Windows: %APPDATA%/Claude/claude_desktop_config.json%

{
  "mcpServers": {
    "usescraper-server": {
      "command": "node",
      "args": ["/path/to/usescraper-server/build/index.js"],
      "env": {
        "USESCRAPER_API_KEY": "your-api-key-here"
      }
    }
  }
}

Replace /path/to/usescraper-server with the actual path of the server and your-api-key-here with your UseScraper API key.

Usage

After configuration, you can use the 'scrape' tool through the MCP interface. Example usage:

{
  "name": "scrape",
  "arguments": {
    "url": "https://example.com",
    "format": "markdown"
  }
}

Development

For automatic rebuilding in the development environment:

npm run watch

Debugging

Since the MCP server communicates via standard input and output, debugging can be challenging. We recommend using MCP Inspector, which can be run as a program script with the following command:

npm run inspector

The Inspector will provide a URL to access the debugging tool in the browser.