Redbook Search Comment MCP2.0

🚀 Xiaohongshu MCP Tool Usage Guide

This tool, implemented with the Playwright framework, effectively simulates user behavior on Xiaohongshu, facilitating content publishing, data collection, and interaction operations.

🚀 Quick Start

1. Environment Setup

# Create and activate a virtual environment
python -m venv env
source env/bin/activate

2. Install Dependencies

pip install -r requirements.txt

3. Login Process

Manual Login

from playwright.sync_api import sync_playwright

with sync_playwright() as p:
    browser = p.chromium.launch(headless=False)
    context = browser.new_context()
    page = context.new_page()
    
    # Visit the Xiaohongshu homepage
    page.goto('https://www.xiaohongshu.com')
    
    # Click the login button and scan the QR code to log in
    page.click('#login-btn')
    page.wait_for_timeout(5000)  # Wait for the QR code scanning to complete

Automated Login (Configure Cookies)

# Configuration file path
COOKIES_PATH = 'cookies.json'

# Load saved cookies
context.add_cookies(json.loads(open(COOKIES_PATH).read()))
page.goto('https://www.xiaohongshu.com')

4. Core Function Implementation

Search Function

def search_note(content):
    page.type('#search-input', content)
    page.press('#search-input', 'Enter')
    page.wait_for_selector('.note-list')  # Wait for the search results to load
    return page.querySelectorAll('.note-item')

Data Collection

def get_note_info(note_element):
    title = note_element.query_selector('.title').text_content()
    author = note_element.query_selector('.author').text_content()
    content = note_element.query_selector('.content').text_content()
    likes = note_element.query_selector('.likes-count').text_content()
    return {
        'Title': title,
        'Author': author,
        'Content': content,
        'Likes': likes
    }

✨ Features

1. Core Features

• User Behavior Simulation: Implement user operations on the Xiaohongshu platform through the Playwright framework, including registration, login, browsing, and liking.
• Data Collection: Support the collection of note information, user information, comment content, and other data, and store it in the database.
• Task Automation: Configure and execute various operational tasks, such as automatically publishing content, interacting (liking, commenting), and managing followers.

2. Technical Architecture

    └─ playwright  # User behavior simulation framework
       └─ browser  # Browser instance
           ├─ page  # Page operations
           └─ context  # Context management (e.g., cookies, localStorage)
                └─ selectors  # Element selector configuration

📦 Installation

The installation steps are included in the "Quick Start" section.

📚 Documentation

1. Code Structure

• xiaohongshu_mcp.py: The core file that implements the main functions, including the code logic for login, search, content and comment retrieval, and comment posting.
• requirements.txt: Records the dependency libraries required for the project.

2. Detailed Usage Instructions

Login Module

Manual Login

# Initialize Playwright and launch the browser
playwright = sync_playwright()
browser = playwright.chromium.launch(headless=False)
context = browser.new_context()
page = context.new_page()

# Visit the login page
page.goto('https://www.xiaohongshu.com/login')

# Enter the phone number
page.type('#phone-input', '13812345678')

# Click the SMS verification code login button
page.click('#sms-login-btn')
page.wait_for_timeout(3000)

# Enter the received verification code
verification_code = input('Please enter the received verification code: ')
page.type('#code-input', verification_code)
page.click('#submit-btn')

Automated Login

# Load saved cookies
context.add_cookies(json.loads(open(COOKIES_PATH).read()))
page.goto('https://www.xiaohongshu.com')

Search Module

def search_notes(keyword):
    page.type('#search-input', keyword)
    page.press('#search-input', 'Enter')
    page.wait_for_selector('.note-list')  # Wait for the search results to load
    return page.querySelectorAll('.note-item')

Collection Module

def extract_note_info(note_element):
    title = note_element.query_selector('h1').text_content()
    author = note_element.query_selector('.author-name').text_content()
    content = note_element.query_selector('.content').text_content()
    likes_count = note_element.query_selector('.likes-count').text_content()
    comments_count = note_element.query_selector('.comments-count').text_content()
    return {
        'Title': title,
        'Author': author,
        'Content': content,
        'Likes': likes_count,
        'Comments': comments_count
    }

Publishing Module

def post_note(content):
    page.goto('https://www.xiaohongshu.com/create/note')
    
    # Enter the note content
    page.type('#content-input', content)
    
    # Submit the post
    page.click('#submit-btn')
    page.wait_for_timeout(2000)  # Wait for the loading to complete

3. Common Issues and Solutions

Login Failure

• Cause: The Xiaohongshu login mechanism has been updated, causing the existing code to become invalid.
• Solution:
  1. Update the Playwright version:

     pip install --upgrade playwright
     

  2. Use the latest verification code processing method:

     page.wait_for_selector('#captcha-input')
     

Web Element Not Found

• Cause: The page structure has changed, causing the query selector to become invalid.
• Solution:
  1. Check the developer tools and update the selector path.
  2. Use a more stable selector (e.g., data-testid) instead of a regular CSS selector.

Performance Issues

• Cause: Multiple operations lead to a decrease in browser performance.
• Solution:
  1. Reasonably set the waiting time:

     page.wait_for_timeout(2000)  # Adjust to an appropriate timeout
     

  2. Use playwright dev for debugging and optimize the script execution path.

4. Advanced Features

Data Storage

import sqlite3

def save_note(note_info):
    conn = sqlite3.connect('notes.db')
    cursor = conn.cursor()
    
    # Create a table (if it doesn't exist)
    cursor.execute('''CREATE TABLE IF NOT EXISTS notes 
                     (id INTEGER PRIMARY KEY AUTOINCREMENT,
                      title TEXT,
                      author TEXT,
                      content TEXT,
                      likes INTEGER)''')
    
    cursor.execute('INSERT INTO notes VALUES (?, ?, ?, ?)',
                   (note_info['Title'], note_info['Author'],
                    note_info['Content'], note_info['Likes']))
    
    conn.commit()

Logging

import logging

# Configure log output
logging.basicConfig(level=logging.INFO,
                   format='%(asctime)s - %(levelname)s - %(message)s')

def log_activity(action):
    logging.info(f'Executed operation: {action}')

🔧 Technical Details

The detailed technical implementation is reflected in the code examples and explanations above.

📄 License

No license information is provided in the original document.

⚠️ Important Note

1. Privacy Protection

• Do not collect user personal information.
• Comply with relevant laws and regulations to avoid data abuse.

2. Platform Rules

• Avoid frequent operations to prevent account suspension.
• Use reasonable time intervals to simulate real user behavior.

3. Exception Handling

try:
    # Perform high-risk operations
except Exception as e:
    logging.error(f'Error occurred: {e}')
    # Automatically exit and report
    page.close()