AIBase
EN
Explore
MCP Doc Scraper
M

MCP Doc Scraper

A document scraping and conversion server based on the MCP protocol that can convert web documents into Markdown format
Developer toolsKnowledge management and memory#Document scraping#Format conversion#MCP service.Python
2.5 points
8.1K
Open Site

Overview

Content Details

Alternatives

What is the Doc Scraper MCP Server?

The Doc Scraper MCP Server is a tool used to scrape online documents and convert HTML - formatted documents into an easy - to - read Markdown format. It supports multiple input sources and generates files that are convenient for storage and sharing.

How to use the Doc Scraper MCP Server?

Simply provide a URL, and the server will automatically scrape the document content and save it as a Markdown file. You can also specify an output path to manage your documents.

Applicable scenarios

Suitable for developers, researchers who need to quickly organize online documents, and any users who want to simplify the document processing process.

Main Features

Web document scraping
Supports scraping document content from any web URL.
HTML to Markdown conversion
Converts complex HTML pages into a concise and easy - to - read Markdown format.
Custom output path
Allows users to choose the location to save the generated Markdown files.
MCP protocol integration
Supports the Model Context Protocol (MCP), facilitating seamless collaboration with other systems.
Advantages
Easy to use, can run without complex configuration.
Supports multiple input sources, with strong adaptability.
The generated Markdown documents are more convenient for long - term storage and sharing.
Compatible with the MCP protocol, with strong scalability.
Limitations
Support for some special formats (such as JavaScript - heavy websites) may be limited.
Relies on external APIs for conversion, and interrupted network connections may affect performance.
Limited to scraping and converting document content, unable to edit the original web page content.

How to Use

Install the Doc Scraper MCP Server
Complete the installation by cloning the repository and setting up a virtual environment.
Start the server
Run the server script to start scraping documents.
Scrape documents
Provide the target URL and specify the output path.

Usage Examples

Scrape official documents
Scrape technical documents from a project's official website and convert them into Markdown.
Organize personal notes
Merge study notes from multiple web pages into a unified Markdown file.

Frequently Asked Questions

Does Doc Scraper support all types of web pages?
How to ensure the accuracy of the scraped data?
Can multiple web pages be scraped in batches?

Related Resources

GitHub Repository
Access project code and more detailed information.
Model Context Protocol Documentation
Understand the working principle and application of the MCP protocol.
Smithery Installation Guide
Quickly deploy the Doc Scraper MCP Server via Smithery.

Installation

Copy the following command to your Client for configuration
Note: Your key is sensitive information, do not share it with anyone.

Alternatives

A
Airweave
Airweave is an open - source context retrieval layer for AI agents and RAG systems. It connects and synchronizes data from various applications, tools, and databases, and provides relevant, real - time, multi - source contextual information to AI agents through a unified search interface.
Python
7.1K
5 points
V
Vestige
Vestige is an AI memory engine based on cognitive science. By implementing 29 neuroscience modules such as prediction error gating, FSRS - 6 spaced repetition, and memory dreaming, it provides long - term memory capabilities for AI. It includes a 3D visualization dashboard and 21 MCP tools, runs completely locally, and does not require the cloud.
Rust
5.6K
4.5 points
M
Moltbrain
MoltBrain is a long-term memory layer plugin designed for OpenClaw, MoltBook, and Claude Code, capable of automatically learning and recalling project context, providing intelligent search, observation recording, analysis statistics, and persistent storage functions.
TypeScript
5.2K
4.5 points
B
Bm.md
A feature-rich Markdown typesetting tool that supports multiple style themes and platform adaptation, providing real-time editing preview, image export, and API integration capabilities
TypeScript
3.6K
5 points
S
Security Detections MCP
Security Detections MCP is a server based on the Model Context Protocol that allows LLMs to query a unified security detection rule database covering Sigma, Splunk ESCU, Elastic, and KQL formats. The latest version 3.0 is upgraded to an autonomous detection engineering platform that can automatically extract TTPs from threat intelligence, analyze coverage gaps, generate SIEM-native format detection rules, run tests, and verify. The project includes over 71 tools, 11 pre-built workflow prompts, and a knowledge graph system, supporting multiple SIEM platforms.
TypeScript
6.1K
4 points
P
Paperbanana
Python
7.7K
5 points
B
Better Icons
An MCP server and CLI tool that provides search and retrieval of over 200,000 icons, supports more than 150 icon libraries, and helps AI assistants and developers quickly obtain and use icons.
TypeScript
5.8K
4.5 points
A
Assistant Ui
assistant - ui is an open - source TypeScript/React library for quickly building production - grade AI chat interfaces, providing composable UI components, streaming responses, accessibility, etc., and supporting multiple AI backends and models.
TypeScript
6.6K
5 points
N
Notion Api MCP
Certified
A Python-based MCP Server that provides advanced to-do list management and content organization functions through the Notion API, enabling seamless integration between AI models and Notion.
Python
20.4K
4.5 points
D
Duckduckgo MCP Server
Certified
The DuckDuckGo Search MCP Server provides web search and content scraping services for LLMs such as Claude.
Python
72.2K
4.3 points
G
Gitlab MCP Server
Certified
The GitLab MCP server is a project based on the Model Context Protocol that provides a comprehensive toolset for interacting with GitLab accounts, including code review, merge request management, CI/CD configuration, and other functions.
TypeScript
24.6K
4.3 points
M
Markdownify MCP
Markdownify is a multi-functional file conversion service that supports converting multiple formats such as PDFs, images, audio, and web page content into Markdown format.
TypeScript
35.5K
5 points
U
Unity
Certified
UnityMCP is a Unity editor plugin that implements the Model Context Protocol (MCP), providing seamless integration between Unity and AI assistants, including real - time state monitoring, remote command execution, and log functions.
C#
32.2K
5 points
F
Figma Context MCP
Framelink Figma MCP Server is a server that provides access to Figma design data for AI programming tools (such as Cursor). By simplifying the Figma API response, it helps AI more accurately achieve one - click conversion from design to code.
TypeScript
64.5K
4.5 points
G
Gmail MCP Server
A Gmail automatic authentication MCP server designed for Claude Desktop, supporting Gmail management through natural language interaction, including complete functions such as sending emails, label management, and batch operations.
TypeScript
22.1K
4.5 points
C
Context7
Context7 MCP is a service that provides real-time, version-specific documentation and code examples for AI programming assistants. It is directly integrated into prompts through the Model Context Protocol to solve the problem of LLMs using outdated information.
TypeScript
97.2K
4.7 points
AIBase
Zhiqi Future, Your AI Solution Think Tank
English简体中文繁體中文にほんご
© 2026AIBase