Scrapegraph MCP

🚀 ScapeGraph Intelligent Server MCP Service

A production-ready Model Context Protocol (MCP) server that offers seamless integration with the ScapeGraph AI API. This server enables language models to leverage advanced AI-driven web scraping capabilities with enterprise-grade reliability.

✨ Features

This server provides the following enterprise-grade tools:

• markdownify(website_url: str): Convert any web page into clean, structured Markdown format.
• smartscraper(user_prompt: str, website_url: str): Use AI to extract structured data from any web page.
• searchscraper(user_prompt: str): Perform AI-driven web searches and obtain structured and actionable results.

📦 Installation

To use this server, you need a ScapeGraph API key. Follow these steps to obtain one:

1. Visit the ScapeGraph Dashboard.
2. Create an account and generate your API key.

Workshop Automated Installation

Automatically install the ScapeGraph API integration server through the Workshop:

npx -y @smithery/cli install @ScrapeGraphAI/scrapegraph-mcp --client claude

Claude Desktop Configuration

Update your Claude desktop configuration file and add the following settings (at the top of the cursor page on the right):

(Remember to add your API key to the configuration)

{
    "mcpServers": {
        "@ScrapeGraphAI-scrapegraph-mcp": {
            "command": "npx",
            "args": [
                "-y",
                "@smithery/cli@latest",
                "run",
                "@ScrapeGraphAI/scrapegraph-mcp",
                "--config",
                "\"{\\\"scrapegraphApiKey\\\":\\\"YOUR-SGAI-API-KEY\\\"}\""
            ]
        }
    }
}

Location of the configuration file:

• Windows: %APPDATA%/Claude/claude_desktop_config.json
• macOS: ~/Library/Application\ Support/Claude/claude_desktop_config.json

Cursor Integration

Add the ScrapeGraphAI MCP server in the settings:

💻 Usage Examples

This server can execute complex queries, such as:

• "Analyze and extract the main features of the ScapeGraph API."
• "Generate a structured Markdown version of the ScapeGraph homepage."
• "Extract and analyze the pricing information on the ScapeGraph website."
• "Research and summarize the latest developments in AI-driven web scraping."
• "Perform an intelligent search based on user prompts."

🔧 Technical Details

Error Handling

• Input Error: If an invalid URL or prompt is provided, the service will return an error message.
• Access Denied: Permission errors may occur when trying to access restricted web pages.
• Timeout: Network latency or heavy server load may cause requests to time out.

📚 Documentation

For more information, please refer to the ScapeGraph API Documentation and the MCP Service Specification.

📄 License

This project is licensed under the MIT License.