How do I use FiftyOne MCP Server?

1. Click on "Install Server". 2. Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state. 3. In the chat, type @ followed by the MCP server name and your instructions, e.g., "@FiftyOne MCP Server Load the quickstart dataset and show me a summary of its contents" That's it! The server will respond to your query, and you can continue using it as needed. Here is a step-by-step guide with screenshots.

FiftyOne MCP Server

Control FiftyOne datasets through AI assistants using the Model Context Protocol

License PyPI Python Discord

Documentation · FiftyOne Skills · FiftyOne Plugins · Discord

What is the FiftyOne MCP Server?

Enable Agents to explore datasets, execute operators, and build computer vision workflows through natural language. This server exposes FiftyOne's operator framework (80+ built-in operators) through 16 MCP tools.

"List all my datasets" "Load quickstart dataset and show summary" "Find similar images in my dataset"

The server starts with 50 built-in operators. Install plugins to expand functionality - the AI can discover and install plugins automatically when needed (brain, zoo, annotation, evaluation, and more).

Available Tools

Category	Tools	Description
📊 Dataset Management	3	List, load, and summarize datasets
⚡ Operator System	5	Execute any FiftyOne operator dynamically
🔌 Plugin Management	5	Discover and install FiftyOne plugins
🖥️ Session Management	3	Control FiftyOne App for delegated execution

Design Philosophy: Minimal tool count (16 tools), maximum flexibility (full operator & plugin ecosystem).

Quick Start

Step 1: Install the MCP Server

pip install fiftyone-mcp-server

⚠️ Important: Make sure to use the same Python environment where you installed the MCP server when configuring your AI tool. If you installed it in a virtual environment or conda environment, you must activate that environment or specify the full path to the executable.

Step 2: Configure Your AI Tool

claude mcp add fiftyone -- fiftyone-mcp

Edit ~/Library/Application Support/Claude/claude_desktop_config.json:

{ "mcpServers": { "fiftyone": { "command": "fiftyone-mcp" } } }

Install in Cursor

Add to ~/.cursor/mcp.json:

{ "mcpServers": { "fiftyone": { "command": "fiftyone-mcp" } } }

Install in VS Code

Add to .vscode/mcp.json:

{ "servers": { "fiftyone": { "command": "fiftyone-mcp" } } }

Edit ~/Library/Application Support/ChatGPT/config.json:

{ "mcpServers": { "fiftyone": { "command": "fiftyone-mcp" } } }

If you have uv installed:

{ "mcpServers": { "fiftyone": { "command": "uvx", "args": ["fiftyone-mcp-server"] } } }

This downloads and runs the latest version automatically.

Step 3: Use It

"List all my datasets" "Load quickstart dataset and show summary" "What operators are available for managing samples?" "Set context to my dataset, then tag high-confidence samples" "What plugins are available? Install the brain plugin" "Find similar images in my dataset"

Claude will automatically discover operators and execute the appropriate tools.

Contributing

We welcome contributions! Here's how to set up a local development environment:

Clone the repository
git clone https://github.com/voxel51/fiftyone-mcp-server.git cd fiftyone-mcp-server
Install dependencies
poetry install
Run the server locally
poetry run fiftyone-mcp
Test your changes
poetry run pytest poetry run black -l 79 src/ npx @modelcontextprotocol/inspector poetry run fiftyone-mcp
Submit a Pull Request

Resources

Resource	Description
FiftyOne Docs	Official documentation
FiftyOne Skills	Expert workflows for AI assistants
FiftyOne Plugins	Official plugin collection
Model Context Protocol	MCP specification
PyPI Package	MCP server on PyPI
Discord Community	Get help and share ideas