PostCrawl MCP Server: Extract Reddit Content via PostCrawl API on Cloudflare Workers

MCP

The PostCrawl MCP Server is a Model Context Protocol service based on Cloudflare Workers, providing access to the PostCrawl API for searching and extracting content from social media platforms (especially Reddit).

Social media Research and data #Social media search #Content extraction #API interface #Reddit crawling .TypeScript

rating : 2 points

downloads : 7.6K

update time : 2025-07-25

Open Site

What is the PostCrawl MCP Server?

The PostCrawl MCP Server is a middleware service that enables AI assistants to conveniently search for and extract content from social media platforms (especially Reddit) through a standardized Model Context Protocol (MCP) interface. You don't need to directly call complex APIs; you can obtain the required content simply by making a simple MCP request.

How to use the PostCrawl MCP Server?

It's very simple to use: 1) Obtain a PostCrawl API key. 2) Connect via the MCP Inspector tool. 3) Send a search or content extraction request. 4) Get the formatted results. There's no need to write complex code throughout the process.

Use cases

Suitable for various scenarios that require obtaining content from social media, such as market research, public opinion monitoring, content aggregation, and AI training data collection. Particularly suitable for applications that need to analyze Reddit content.

Main Features

Social media search

Search for social media content across platforms, supporting custom query parameters and pagination.

Content extraction

Extract the full content from a specific URL, optionally including comments and replies.

Markdown format output

Get the formatted content for direct display or further processing.

Health status check

Check the API service status at any time to ensure service availability.

Advantages

Simplifies the complexity of social media APIs and provides a unified interface.

Supports direct conversion of content to Markdown format.

Based on Cloudflare Workers, with fast response speed.

Flexible search parameter configuration.

Limitations

Currently mainly supports the Reddit platform, with limited support for other platforms.

The extraction depth is limited by the original platform's API.

Requires a valid PostCrawl API key.

How to Use

Obtain an API key

First, you need to obtain a valid API key from PostCrawl.

Install the testing tool

It is recommended to use the MCP Inspector tool for testing.

Connect to the server

Use the Streamable HTTP transport type in the MCP Inspector to connect to https://postcrawl.com/mcp.

Set authentication

Add an Authorization header in the format: Bearer YOUR_POSTCRAWL_API_KEY.

Start using

Now you can test various tool functions.

Usage Examples

Monitor hot topics on Reddit

Regularly search for hot topics on Reddit to understand the current focus of the community.

Extract complete discussion content

Obtain all the content and comments of a specific post for detailed analysis.

Frequently Asked Questions

Is it free?

Which social media platforms are supported?

How to obtain an API key?

Is there a call frequency limit?

Related Resources

PostCrawl official website

Obtain an API key and official documentation.

MCP Inspector tool

An interactive tool for testing the MCP server.

Cloudflare Workers documentation

Understand the technical details of the underlying operating environment.

🚀 PostCrawl MCP Server

A Cloudflare Workers-based Model Context Protocol (MCP) server that offers access to the PostCrawl API for searching and extracting content from social media platforms, especially Reddit.

🚀 Quick Start

Prerequisites

Node.js (latest LTS version)
Bun (recommended) or npm
A Cloudflare account (for deployment)
PostCrawl API key
MCP Inspector (for testing)

Installation

Install dependencies:

npm install

Start development server:

bun dev

The server will be available at http://localhost:8787

Testing with MCP Inspector

The simplest way to test this MCP server is using MCP Inspector.

📖 See how-to-use.md for detailed step-by-step instructions with screenshots.

Quick overview:

Install MCP Inspector: npx @modelcontextprotocol/inspector
Use "Streamable HTTP" transport type
Connect to: https://postcrawl.com/mcp
Add Authorization header with your PostCrawl API key
Test the available tools

✨ Features

PostCrawl is an API service that allows you to search for posts across social media platforms and extract their content. This MCP server provides a seamless interface to the PostCrawl API, enabling AI assistants to:

Search for posts with customizable parameters
Extract content from specific URLs
Retrieve posts with markdown formatting
Control extraction depth with simplified boolean parameter
Check API health status

📦 Installation

The installation steps are as follows:

Install dependencies:

npm install

Start development server:

bun dev

The server will be available at http://localhost:8787

📚 Documentation

Authentication

The server requires a PostCrawl API key provided as a Bearer token:

Authorization: Bearer YOUR_POSTCRAWL_API_KEY

Available MCP Tools

1. search

Search for posts across social media platforms.

Parameters:

query (string, required): Search query
page (int, optional): Page number (default: 1)
results (int, optional): Number of results (default: 10)
social_platforms (string[], optional): Social platforms to search

2. search_and_extract

Search for posts and extract their content in a single operation.

Same parameters as search with additional:

response_mode (string, optional): Response format - "raw" or "markdown" (default: "raw")
include_comments (boolean, optional): Include comments and replies (default: false)

3. extract

Extract content from specific URLs.

Parameters:

urls (string[], required): List of URLs to extract content from
include_comments (boolean, optional): Include comments and replies (default: false)
response_mode (string, optional): Response format - "raw" or "markdown" (default: "raw")