Vrknetha MCP Server Firecrawl

🚀 FireCrawl MCP Server

An implementation of the Model Context Protocol (MCP) server integrated with FireCrawl for advanced web crawling capabilities.

✨ Features

• JavaScript Rendering: Extract content from JavaScript-rich websites.
• Mobile/Desktop Views: Support different viewport configurations.
• Intelligent Rate Limiting: Built-in rate limit handling.
• Multiple Formats: Support extraction in HTML, Markdown, screenshots, and plain text.
• Batch Processing: Efficiently process multiple URLs.
• Content Filtering: Include or exclude specific HTML tags.

🛠️ Tools

fire_crawl_scrape

Crawl content from a single URL with custom options.

• Input:
  • url (string): The target URL to crawl.
  • formats (array): Output formats (markdown, html, rawHtml, screenshot, links, screenshot@fullPage, extract).
  • waitFor (number, optional): Waiting time in milliseconds.
  • onlyMainContent (boolean, optional): Extract only the main content.
  • includeTags (array, optional): HTML tags to specifically include.
  • excludeTags (array, optional): HTML tags to exclude.
  • mobile (boolean, optional): Use the mobile view.
  • skipTlsVerification (boolean, optional): Skip TLS verification.

fire_crawl_batch

Initiate a batch crawling job for multiple URLs.

• Input:
  • urls (array): A list of URLs to crawl.
  • formats (array): Output formats (same as single crawl).
  • Other options are the same as fire_crawl_scrape.

fire_crawl_status

Check the status of a batch crawling job.

• Input:
  • id (string): The ID of the batch job to check.

📦 Installation

npm install mcp-server-firecrawl

⚙️ Configuration

Obtain an API Key

1. Sign up on your FireCrawl account.
2. Generate your API key from the dashboard.
3. Set the API key in the environment variables.

Using Claude Desktop

Add the following to claude_desktop_config.json:

{
  "mcpServers": {
    "mcp-server-firecrawl": {
      "command": "npx",
      "args": ["-y", "mcp-server-firecrawl"],
      "env": {
        "FIRE_CRAWL_API_KEY": "YOUR_API_KEY_HERE"
      }
    }
  }
}

💻 Development

# Install dependencies
npm install

# Build
npm run build

# Run tests
npm test

⏱️ Rate Limiting

• Free tier: 3 requests per minute.
• Wait for a 25-second cooldown period after reaching the rate limit.
• Higher limits are available in paid plans.

📄 License

MIT License - See the LICENSE file for details.