Desktop Controller MCP Server

Give any AI full control of your desktop. Mouse, keyboard, screenshots — all through the Model Context Protocol.

One MCP server. Ten tools. Your AI can now see your screen and interact with any application, just like you do.

What can it do?

• See your screen — Take full or partial screenshots, auto-optimized for LLM token usage

• Move & click — Navigate, click, double-click, right-click, drag and drop

• Type anything — Full keyboard control including Unicode, emoji, and key combos (Cmd+C, Ctrl+Shift+T, etc.)

• Cross-platform — Works on macOS, Windows, and Linux

Related MCP server: openowl

Tools

Quick Start

Install

git clone https://github.com/YOUR_USERNAME/mcp-desktop-controller.git
cd mcp-desktop-controller
pip install -e .

Add to Claude Desktop

Add to your config (~/Library/Application Support/Claude/claude_desktop_config.json):

{
  "mcpServers": {
    "desktop-controller": {
      "command": "mcp-desktop-controller"
    }
  }
}

{
  "mcpServers": {
    "desktop-controller": {
      "command": "/path/to/venv/bin/mcp-desktop-controller"
    }
  }
}

Add to Claude Code

claude mcp add desktop-controller -- mcp-desktop-controller

macOS Permissions

On first run, you'll need to grant two permissions in System Settings > Privacy & Security:

1. Accessibility — so the server can control mouse and keyboard

2. Screen Recording — so it can take screenshots

Safety

• Failsafe — Move your mouse to the top-left corner (0,0) to instantly abort any action

• Action pause — 0.1s delay between all actions to keep things predictable

• Retina-aware — All coordinates use logical resolution; screenshots are auto-downscaled to save tokens

How it works

Built with FastMCP and PyAutoGUI. The server exposes desktop control as MCP tools over stdio. Any MCP-compatible client (Claude Desktop, Claude Code, or your own) connects and gets full desktop access.

Your AI  ←→  MCP Client  ←→  Desktop Controller  ←→  Your Screen

Platform Support

Development

# Run directly
python server.py

# Test with MCP Inspector
fastmcp dev server.py

License

MIT