MCP Doc Scraper
M

MCP Doc Scraper

A document scraping and conversion server based on the MCP protocol that can convert web documents into Markdown format
2.5 points
7.7K

What is the Doc Scraper MCP Server?

The Doc Scraper MCP Server is a tool used to scrape online documents and convert HTML - formatted documents into an easy - to - read Markdown format. It supports multiple input sources and generates files that are convenient for storage and sharing.

How to use the Doc Scraper MCP Server?

Simply provide a URL, and the server will automatically scrape the document content and save it as a Markdown file. You can also specify an output path to manage your documents.

Applicable scenarios

Suitable for developers, researchers who need to quickly organize online documents, and any users who want to simplify the document processing process.

Main Features

Web document scraping
Supports scraping document content from any web URL.
HTML to Markdown conversion
Converts complex HTML pages into a concise and easy - to - read Markdown format.
Custom output path
Allows users to choose the location to save the generated Markdown files.
MCP protocol integration
Supports the Model Context Protocol (MCP), facilitating seamless collaboration with other systems.
Advantages
Easy to use, can run without complex configuration.
Supports multiple input sources, with strong adaptability.
The generated Markdown documents are more convenient for long - term storage and sharing.
Compatible with the MCP protocol, with strong scalability.
Limitations
Support for some special formats (such as JavaScript - heavy websites) may be limited.
Relies on external APIs for conversion, and interrupted network connections may affect performance.
Limited to scraping and converting document content, unable to edit the original web page content.

How to Use

Install the Doc Scraper MCP Server
Complete the installation by cloning the repository and setting up a virtual environment.
Start the server
Run the server script to start scraping documents.
Scrape documents
Provide the target URL and specify the output path.

Usage Examples

Scrape official documents
Scrape technical documents from a project's official website and convert them into Markdown.
Organize personal notes
Merge study notes from multiple web pages into a unified Markdown file.

Frequently Asked Questions

Does Doc Scraper support all types of web pages?
How to ensure the accuracy of the scraped data?
Can multiple web pages be scraped in batches?

Related Resources

GitHub Repository
Access project code and more detailed information.
Model Context Protocol Documentation
Understand the working principle and application of the MCP protocol.
Smithery Installation Guide
Quickly deploy the Doc Scraper MCP Server via Smithery.

Installation

Copy the following command to your Client for configuration
Note: Your key is sensitive information, do not share it with anyone.

Alternatives

M
MCP
The Microsoft official MCP server provides search and access functions for the latest Microsoft technical documentation for AI assistants
10.0K
5 points
A
Aderyn
Aderyn is an open - source Solidity smart contract static analysis tool written in Rust, which helps developers and security researchers discover vulnerabilities in Solidity code. It supports Foundry and Hardhat projects, can generate reports in multiple formats, and provides a VSCode extension.
Rust
5.9K
5 points
D
Devtools Debugger MCP
The Node.js Debugger MCP server provides complete debugging capabilities based on the Chrome DevTools protocol, including breakpoint setting, stepping execution, variable inspection, and expression evaluation.
TypeScript
6.4K
4 points
S
Scrapling
Scrapling is an adaptive web scraping library that can automatically learn website changes and re - locate elements. It supports multiple scraping methods and AI integration, providing high - performance parsing and a developer - friendly experience.
Python
7.9K
5 points
M
Mcpjungle
MCPJungle is a self-hosted MCP gateway used to centrally manage and proxy multiple MCP servers, providing a unified tool access interface for AI agents.
Go
0
4.5 points
C
Cipher
Cipher is an open-source memory layer framework designed for programming AI agents. It integrates with various IDEs and AI coding assistants through the MCP protocol, providing core functions such as automatic memory generation, team memory sharing, and dual-system memory management.
TypeScript
0
5 points
N
Nexus
Nexus is an AI tool aggregation gateway that supports connecting multiple MCP servers and LLM providers, providing tool search, execution, and model routing functions through a unified endpoint, and supporting security authentication and rate limiting.
Rust
0
4 points
S
Shadcn Ui MCP Server
An MCP server that provides shadcn/ui component integration for AI workflows, supporting React, Svelte, and Vue frameworks. It includes functions for accessing component source code, examples, and metadata.
TypeScript
12.2K
5 points
G
Gitlab MCP Server
Certified
The GitLab MCP server is a project based on the Model Context Protocol that provides a comprehensive toolset for interacting with GitLab accounts, including code review, merge request management, CI/CD configuration, and other functions.
TypeScript
16.6K
4.3 points
N
Notion Api MCP
Certified
A Python-based MCP Server that provides advanced to-do list management and content organization functions through the Notion API, enabling seamless integration between AI models and Notion.
Python
14.8K
4.5 points
D
Duckduckgo MCP Server
Certified
The DuckDuckGo Search MCP Server provides web search and content scraping services for LLMs such as Claude.
Python
44.1K
4.3 points
M
Markdownify MCP
Markdownify is a multi-functional file conversion service that supports converting multiple formats such as PDFs, images, audio, and web page content into Markdown format.
TypeScript
23.7K
5 points
U
Unity
Certified
UnityMCP is a Unity editor plugin that implements the Model Context Protocol (MCP), providing seamless integration between Unity and AI assistants, including real - time state monitoring, remote command execution, and log functions.
C#
19.2K
5 points
F
Figma Context MCP
Framelink Figma MCP Server is a server that provides access to Figma design data for AI programming tools (such as Cursor). By simplifying the Figma API response, it helps AI more accurately achieve one - click conversion from design to code.
TypeScript
44.6K
4.5 points
G
Gmail MCP Server
A Gmail automatic authentication MCP server designed for Claude Desktop, supporting Gmail management through natural language interaction, including complete functions such as sending emails, label management, and batch operations.
TypeScript
15.0K
4.5 points
M
Minimax MCP Server
The MiniMax Model Context Protocol (MCP) is an official server that supports interaction with powerful text-to-speech, video/image generation APIs, and is suitable for various client tools such as Claude Desktop and Cursor.
Python
29.4K
4.8 points
AIBase
Zhiqi Future, Your AI Solution Think Tank
© 2025AIBase