Http Rquest

🚀 mcp-rquest

A server based on the Model Context Protocol (MCP) that provides advanced HTTP request capabilities for Claude and other large language models. It enables models to interact with websites more naturally and bypass common anti-bot measures.

🚀 Quick Start

mcp-rquest is a server based on the Model Context Protocol (MCP), offering advanced HTTP request capabilities for Claude and other large language models. Built on rquest, it supports realistic browser emulation and accurate TLS/JA3/JA4 fingerprinting. This allows models to interact with websites more naturally and bypass common anti-bot measures. It also supports converting PDF and HTML documents into Markdown for easier processing by LLMs.

✨ Features

• Full HTTP Methods: Supports GET, POST, PUT, DELETE, PATCH, HEAD, OPTIONS, and TRACE.
• Browser Fingerprinting: Accurate TLS, JA3/JA4, and HTTP/2 browser fingerprints.
• Content Handling:
  • Automatically handles large responses with token counting.
  • Converts HTML to Markdown for better LLM processing.
  • Converts PDF to Markdown using the Marker library.
  • Securely stores responses in the system's temporary directory.
• Browser Emulation: Supports Chrome (multiple versions), Firefox, Safari (including iOS and iPad versions), Edge, and OkHttp, ensuring requests appear to come from standard browsers rather than bots.

📦 Installation

Install with pip:

pip install mcp-rquest

Configure the MCP Server

Create a mcp_server.json file in the project root directory and add the following content:

{
    "bind": ":3000",
    "workers": 4,
    "browser_fingerprints": {
        "chrome": true,
        "firefox": true,
        "safari": true,
        "edge": true,
        "okhttp": true
    },
    "features": {
        "content_conversion": true,
        "proxy_support": true,
        "rate_limiting": false
    }
}

Start the Server

mcp-rquest start --config mcp_server.json

💻 Usage Examples

Basic Usage

import requests

response = requests.get("http://localhost:3000", params={"param": "value"})
print(response.text)

🔧 Technical Details

Browser Fingerprint Emulation

mcp-rquest leverages rquest's powerful browser emulation capabilities to provide realistic browser fingerprints, helping to bypass anti-bot detection and access content typically restricted to standard browsers. Supported browser fingerprints include:

• Chrome (multiple versions)
• Firefox
• Safari (including iOS and iPad versions)
• Edge
• OkHttp

This ensures that requests sent through mcp-rquest appear to be legitimate browser traffic rather than bot requests.

Development Environment Setup

1. Clone the repository:

git clone https://github.com/xxxbrian/mcp-rquest.git

2. Create a virtual environment (using uv):

uv venv

3. Activate the virtual environment:

# Unix/macOS
source .venv/bin/activate
# Windows
.venv\Scripts\activate

4. Install development dependencies:

uv pip install -e ".[dev]"

📄 License

This project is based on rquest, which provides advanced HTTP client and browser fingerprinting capabilities. rquest is a fork of reqwest.