Tatn MCP Server Fetch Python

🚀 mcp-server-fetch-python

An MCP server for scraping and converting web content into various formats. This server offers comprehensive tools for extracting content from web pages, including support for JavaScript-rendered content and media files.

🚀 Quick Start

This MCP server simplifies the process of fetching and converting web content. It provides a suite of tools to meet different needs, from raw text extraction to media content analysis.

✨ Features

Tools

The server provides four dedicated tools:

• get-raw-text: Extracts raw text content directly from a URL without browser rendering.

  • Parameters:
    • url: The URL of the target web page (required).
  • Ideal for handling structured data formats or when quick access is needed.

• get-rendered-html: Retrieves fully rendered HTML content using a headless browser.

  • Parameters:
    • url: The URL of the target web page (required).
  • Essential for modern web applications and SPAs.

• get-markdown: Converts web page content into well-formatted Markdown.

  • Parameters:
    • url: The URL of the target web page (required).
  • Provides clean and readable text output while preserving structural elements.

• get-markdown-from-media: Performs AI-driven content extraction on media files.

  • Parameters:
    • url: The URL of the target media file (image, video) (required).
  • Utilizes computer vision and OCR technology to analyze visual content.
  • Requires setting a valid OPENAI_API_KEY as an environment variable.
  • Returns an error message if the API key is not set or if there are issues processing the media file.

💻 Usage Examples

Claude Desktop

To use in Claude Desktop, add the server configuration:

On MacOS: ~/Library/Application\ Support/Claude/claude_desktop_config.json On Windows: %APPDATA%/Claude/claude_desktop_config.json

"mcpServers": {
  "mcp-server-fetch-python": {
    "command": "uvx",
    "args": [
      "mcp-server-fetch-python"
    ]
  }
}

Environment Variables

The following environment variables can be configured:

• OPENAI_API_KEY: Required when using the get-markdown-from-media tool. This key is used for AI-driven image analysis and content extraction.
• PYTHONIOENCODING: Set to "utf-8" if you encounter character encoding issues.
• MODEL_NAME: Specifies the model name to use, defaulting to "gpt-4o".

"mcpServers": {
  "mcp-server-fetch-python": {
    "command": "uvx",
    "args": [
      "mcp-server-fetch-python"
    ],
    "env": {
        "OPENAI_API_KEY": "sk-****",
        "PYTHONIOENCODING": "utf-8",
        "MODEL_NAME": "gpt-4o",        
    }
  }
}

Local Installation

Alternatively, you can install and run the server locally:

git clone https://github.com/tatn/mcp-server-fetch-python.git
cd mcp-server-fetch-python
uv sync
uv build

Then add the following configuration to the Claude Desktop configuration file:

"mcpServers": {
  "mcp-server-fetch-python": {
    "command": "uv",
    "args": [
      "--directory",
      "path\\to\\mcp-server-fetch-python",  # Replace with the actual path of the cloned repository
      "run",
      "mcp-server-fetch-python"
    ]
  }
}

🔧 Technical Details

Debugging

You can start the MCP Inspector using npx with the following commands:

npx @modelcontextprotocol/inspector uvx mcp-server-fetch-python

npx @modelcontextprotocol/inspector uv --directory path\\to\\mcp-server-fetch-python run mcp-server-fetch-python