Usescraper MCP Server

🚀 UseScraper MCP Server

This is a TypeScript-based MCP server that provides web scraping functionality using the UseScraper API. It exposes a single tool named 'scrape' that can extract content from web pages in multiple formats.

🚀 Quick Start

This TypeScript-based MCP server offers web scraping capabilities via the UseScraper API. It exposes a 'scrape' tool to extract web - page content in various formats.

✨ Features

Tools

• scrape - Extract content from web pages
  • Parameters:
    • url (Required): The URL of the web page to scrape.
    • format (Optional): The format to save the content (text, html, markdown). Default: markdown.
    • advanced_proxy (Optional): Use an advanced proxy to bypass anti - scraping detection. Default: false.
    • extract_object (Optional): Specify the object of the data to be extracted.

📦 Installation

Installation via Smithery

To automatically install UseScraper for Claude Desktop, execute the following command via Smithery:

npx -y @smithery/cli install usescraper-server --client claude

Manual Installation

1. Clone the repository:

   git clone https://github.com/your-repo/usescraper-server.git
   cd usescraper-server
   

2. Install dependencies:

   npm install
   

3. Build the server:

   npm run build
   

📚 Documentation

Configuration

To use it with Claude Desktop, add the server configuration: On MacOS: ~/Library/Application Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json%

{
  "mcpServers": {
    "usescraper-server": {
      "command": "node",
      "args": ["/path/to/usescraper-server/build/index.js"],
      "env": {
        "USESCRAPER_API_KEY": "your-api-key-here"
      }
    }
  }
}

Replace /path/to/usescraper-server with the actual path of the server and your-api-key-here with your UseScraper API key.

💻 Usage Examples

Basic Usage

After configuration, you can use the 'scrape' tool through the MCP interface. Example usage:

{
  "name": "scrape",
  "arguments": {
    "url": "https://example.com",
    "format": "markdown"
  }
}

🔧 Technical Details

Development

For feature development with automatic rebuild:

npm run watch

Debugging

Since the MCP server communicates via standard input and output, debugging can be challenging. We recommend using MCP Inspector, which is provided as a package script:

npm run inspector

The Inspector will provide a URL for you to access the debugging tool in your browser.