Scraper.is

Scraper.is MCP is a web scraping tool integration package based on the Model Context Protocol (MCP), which allows AI assistants to scrape web content through the MCP protocol, supporting multiple format outputs and real-time progress updates.

Research and data Developer tools #Web scraping #AI tools #Data extraction #MCP integration .TypeScript

rating : 2 points

downloads : 12

update time : 2025-04-23

What is Scraper.is MCP?

Scraper.is MCP is a bridge that connects AI assistants to web content through the Model Context Protocol (MCP). It enables your AI assistant to scrape information from websites, capture screenshots, and retrieve data in multiple formats - all through simple natural language requests.

How to use Scraper.is MCP?

After installation and API key setup, you can simply ask your AI assistant to fetch web content for you. The assistant will handle the technical details while you get the information you need in your preferred format.

Use Cases

Perfect for research, competitive analysis, news monitoring, price tracking, and any scenario where you need current information from websites without manual browsing.

Key Features

Web Content ExtractionExtract text and data from any public website with a simple request to your AI assistant.

Multiple Output FormatsGet results in markdown, HTML, JSON, or as screenshots depending on your needs.

Visual CaptureCapture full-page screenshots to see exactly how a webpage appears visually.

Real-time ProgressGet updates during longer scraping operations so you know the status of your request.

Pros and Cons

Advantages

No technical knowledge required - works through natural language

Access to real-time web data directly within your AI assistant

Supports multiple content formats for different use cases

Seamless integration with MCP-compatible AI systems

Limitations

Requires a Scraper.is API key (free tier available)

May not work with some JavaScript-heavy websites

Rate limits apply based on your subscription plan

Getting Started

Obtain API Key

Install Package

Install the package globally on your system.

Configure AI Assistant

Add the MCP server configuration to your AI assistant's settings file.

Start Using

Restart your AI assistant and begin making scraping requests.

Example Use Cases

News MonitoringGet the latest news headlines from your favorite news site

Product ResearchCompare products across e-commerce sites

Visual VerificationCheck how a webpage appears visually

Frequently Asked Questions

Is there a free tier available?

Can I scrape login-protected pages?

How do I know if my AI assistant supports MCP?

Why is my scraping request taking so long?

Additional Resources

Scraper.is Website

Official website with API documentation and account management

MCP Specification

Technical details about the Model Context Protocol

API Key Dashboard

Where to manage your Scraper.is API keys

🚀 Scraper.is MCP Integration Package

A Model Context Protocol (MCP) integration package for Scraper.is, a powerful web scraping tool designed for AI assistants.

This package integrates with Scraper.is via the MCP protocol, allowing AI assistants to access real-time information from the web.

🚀 Quick Start

To get started with the Scraper.is MCP integration package, you first need to install it and obtain an API key. Then you can configure it according to your needs.

✨ Features

🌐 Web Scraping: Extract content from any website.
📸 Screenshots: Capture visual representations of web pages.
📄 Multiple Formats: Get content in Markdown, HTML, or JSON.
🔄 Progress Updates: Report the progress of scraping operations in real-time.
🔌 MCP Integration: Seamlessly integrate with AI assistants that support MCP.

📦 Installation

You can install the package using npm or yarn:

npm install -g scraperis-mcp

Or use yarn:

yarn global add scraperis-mcp

Prerequisites

You need a Scraper.is API key to use this package.

Get Your API Key

Sign up or log in at scraper.is.
Visit the API Keys section in the dashboard: https://www.scraper.is/dashboard/apikeys.
Create a new key or copy an existing one.
Securely save this key as you'll need it to use this package.

💻 Usage Examples

Basic Usage

Environment Setup

Create a .env file and add your Scraper.is API key:

SCRAPERIS_API_KEY=your_api_key_here

Integration with Claude Desktop

To use this package with Claude Desktop:

Install the package globally:
```
npm install -g scraperis-mcp
```

Add the following configuration to the claude_desktop_config.json file:

{
  "mcpServers": {
    "scraperis_scraper": {
      "command": "scraperis-mcp",
      "args": [],
      "env": {
        "SCRAPERIS_API_KEY": "your-api-key-here",
        "DEBUG": "*"
      }
    }
  }
}

Replace your-api-key-here with your actual Scraper.is API key.
Restart Claude Desktop to apply the changes.

Development and Testing with MCP Inspector

npx @modelcontextprotocol/inspector scraperis-mcp

Integration with AI Assistants

This package is designed for AI assistants that support the Model Context Protocol (MCP). After configuration, AI assistants can use the following tools:

scrape Tool

Scrape content from web pages.

Advanced Usage

The package can be integrated with various AI assistants supporting MCP. After proper configuration, AI assistants can use the scrape tool to extract content from web pages.

📚 Documentation

API Reference

Parameters

url: The URL to scrape.
output_format: The output format, supporting text, html, or json.
proxy: Optional proxy server address.

Example Response

{
  "content": "...",
  "status": "success"
}

🔧 Technical Details

Development

Install Dependencies

npm install

Start the Service

npm start

🤝 Contribution

Contributions are welcome! Please check the contribution guidelines in the GitHub repository.

📄 License

MIT License

This document provides a complete guide for using and configuring the Scraper.is MCP integration package, suitable for developers and technology enthusiasts.