Fiftyone MCP Server

🚀 FiftyOne MCP Server

Control FiftyOne datasets through AI assistants using the Model Context Protocol

🚀 Quick Start

Option 1: pip (Simplest)

Install the package using pip:

pip install fiftyone-mcp-server

Then add it to your AI tool configuration and restart:

{
  "mcpServers": {
    "fiftyone": {
      "command": "fiftyone-mcp"
    }
  }
}

claude mcp add fiftyone -- fiftyone-mcp

{
  "fiftyone": {
    "command": "fiftyone-mcp"
  }
}

{
  "servers": {
    "fiftyone": {
      "command": "fiftyone-mcp"
    }
  }
}

{
  "mcpServers": {
    "fiftyone": {
      "command": "fiftyone-mcp"
    }
  }
}

Option 2: uvx (No Install Needed)

If you have uv installed:

{
  "mcpServers": {
    "fiftyone": {
      "command": "uvx",
      "args": ["fiftyone-mcp-server"]
    }
  }
}

This will automatically download and run the latest version.

✨ Features

• Dataset Management (3 tools) - List, load, and summarize datasets.
• Operator System (5 tools) - Dynamically execute any FiftyOne operator.
• Plugin Management (5 tools) - Discover and install FiftyOne plugins.
• Session Management (3 tools) - Control the FiftyOne App for delegated execution.
• Natural Language Workflows - Perform multi-step operations through conversations.
• ChatGPT & Claude Compatible - Works with desktop applications.

💻 Usage Examples

Basic Usage

After configuration, restart your AI assistant and try the following commands:

"List all my datasets"
"Load quickstart dataset and show summary"
"What operators are available for managing samples?"
"Set context to my dataset, then tag high-confidence samples"
"What plugins are available? Install the brain plugin"
"Find similar images in my dataset"

The server starts with 50 built - in operators. Install plugins to expand its functionality. The AI can discover and install plugins automatically when needed (such as brain, zoo, annotation, evaluation, etc.).

📚 Documentation

Overview

Enable ChatGPT and Claude to explore datasets, execute operators, and build computer vision workflows through natural language. This server exposes FiftyOne's operator framework (80+ built - in operators) through 16 MCP tools.

Architecture

Design Philosophy: Minimize the number of tools (16 tools) while maximizing flexibility (full operator & plugin ecosystem).

🤝 Contributing

We welcome contributions! Here's how to set up a local development environment.

Local Development Setup

# Clone the repository
git clone https://github.com/AdonaiVera/fiftyone-mcp-server.git
cd fiftyone-mcp-server

# Install Poetry (if not installed)
curl -sSL https://install.python-poetry.org | python3 -

# Install dependencies
poetry install

# Run the server locally
poetry run fiftyone-mcp

Testing Your Changes

# Run tests
poetry run pytest

# Code formatting
poetry run black -l 79 src/

# Linting
poetry run pylint --errors-only src/

# Test with MCP Inspector
npx @modelcontextprotocol/inspector poetry run fiftyone-mcp

Using Local Version with Claude

To test your local changes with Claude Desktop, update your configuration:

{
  "mcpServers": {
    "fiftyone": {
      "command": "poetry",
      "args": ["run", "fiftyone-mcp"],
      "cwd": "/absolute/path/to/fiftyone-mcp-server"
    }
  }
}

📚 Resources

• FiftyOne Docs
• FiftyOne Operators
• Model Context Protocol
• MCP Inspector
• PyPI Package

Built with FiftyOne and Model Context Protocol