Fetch Browser

Fetch Browser is a powerful headless browser MCP server designed for AI agents, which can obtain web page content and perform Google searches without API keys. It supports multiple content format conversions and intelligent error handling.

Browser automation Developer tools .TypeScript

rating : 2.5 points

downloads : 90

update time : 2025-04-28

What is Fetch Browser?

Fetch Browser is a powerful MCP server that allows AI agents to directly scrape web page content and perform Google searches through a headless browser without any API keys.

How to use Fetch Browser?

Through a simple command-line tool, you can easily scrape web pages or search on Google. Just provide the URL or search keywords to get the desired content.

Applicable Scenarios

Suitable for scenarios that require quickly scraping web page content, performing Google searches, and handling various data formats.

Main Features

No API Keys RequiredUse modern headless browser technology to directly access web page content.

Smart Google SearchExtract structured data from Google search results, support news and web searches, and customize the number of results.

Universal Content ScrapingSupport scraping of any web page or API endpoint and support multiple output formats (HTML, JSON, Text, Markdown).

Format ConversionConvert HTML to Markdown, beautify JSON output, and generate structured HTML and plain text.

Security FeaturesResponse size limit, request timeout protection, rate limit protection, and detailed error handling.

Advantages and Limitations

Advantages

Can run without API keys

Support multiple output formats

Automatic retry mechanism and error handling

Flexible search engine integration

Limitations

May be affected by the anti - scraping strategies of target websites

Some advanced features require high system resources

How to Use

Install Fetch Browser

Install Fetch Browser through the Smithery CLI or manually clone the code repository.

Start the Server

After the installation is complete, run the command to start the server.

Execute Commands

Use the provided tools such as `fetch_url` or `google_search` to scrape web pages or search on Google.

Usage Examples

Example 1: Scrape Web Page ContentScrape the content of a website and convert it to Markdown format.

Example 2: Google SearchSearch for information about artificial intelligence and extract the top 10 results.

Frequently Asked Questions

Does Fetch Browser require API keys?

How to change the number of search results?

Related Resources

Official Documentation

The GitHub code repository of Fetch Browser.

Author's Personal Website

The official website of the creator, Seth Rose.

Video Tutorial

A video tutorial for Fetch Browser.

🚀 Headless Browser MCP Server

A powerful headless browser MCP server that allows AI agents to directly fetch web page content and perform Google searches without any API keys. Built on modern web standards and designed for seamless integration with AI platforms.

✨ Features

No API Key Required: Utilizes advanced headless browser techniques to directly scrape content.
Intelligent Google Search:
- Extracts structured search results.
- Supports web and news results.
- Configurable number of results (1 - 100).
- Retrieves full search result content.
- Automatically retries and handles errors.
Universal Content Scraping:
- Supports any web page or API endpoint.
- Offers multiple output formats (HTML, JSON, text, Markdown).
- Automatically detects content types.
- Protects against response size limits and timeouts.
- Protects against rate limits.
Format Conversion:
- Converts clean HTML to Markdown.
- Provides neatly printed JSON responses.
- Outputs structured HTML.
- Offers plain text with proper formatting.

💻 Usage Examples

Google Search Tool (`google_search`)

Perform a Google search and get the full content of the results:

{
  query: "Your search query",
  responseType: "markdown", // or "json", "html", "text"
  maxResults: 10,          // 1 - 100 results
  topic: "web"            // or "news"
}

URL Fetching Tool (`fetch_url`)

Fetch content from any URL:

{
  url: "https://example.com",
  responseType: "markdown", // or "json", "html", "text"
  timeout: 30000          // Optional, in milliseconds
}

📦 Installation

Via Smithery

# For Claude
npx -y @smithery/cli install @TheSethRose/fetch-browser --client claude

# For Cursor
npx -y @smithery/cli install @TheSethRose/fetch-browser --client cursor

# For TypeScript
npx -y @smithery/cli install @TheSethRose/fetch-browser --client typescript

Manual Installation

# Clone the repository
git clone https://github.com/TheSethRose/fetch-browser.git
cd fetch-browser

# Install dependencies
npm install

# Build the project
npm run build

# Start the server
npm start

🔧 Development

# Auto-reload in watch mode
npm run dev

# Run tests
npm test

# Generate build files
npm run build

# Start in production mode
npm start

📚 Documentation

Response Formats

Markdown Format

## [Page Title](https://example.com)

This is a sample text.

JSON Format

{
  "title": "Sample Page",
  "content": "This is sample content in JSON format."
}

HTML Format

<!DOCTYPE html>
<html lang="zh-CN">
<head>
    <meta charset="UTF-8">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <title>Sample Page</title>
</head>
<body>
    <h1>Sample Title</h1>
    <p>This is sample content in HTML format.</p>
</body>
</html>

Text Format

Sample text content

Error Handling

Timeout Error: Triggered when a request does not complete within the specified time.
Network Error: Caused by connection issues.
Parsing Error: Occurs when the returned content cannot be parsed.

Security Features

Rate Limiting: Prevents excessive requests in a short period.
IP Whitelisting: Allows access only from specific IP addresses.
Logging: Records all requests and responses for debugging and monitoring.

👨‍💻 Project Maintainers

Seth Rose
- Website: srose.dev
- Resume: linkedin.com/in/sethroose

📄 License

This project is open-source under the MIT License:

MIT License

Copyright (c) 2024 Seth Rose

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.

For more details, please refer to the LICENSE file.