Skip to main content
Glama
KumaVolt

Desktop Controller MCP Server

by KumaVolt
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Local

Desktop Controller MCP Server

Give any AI full control of your desktop. Mouse, keyboard, screenshots — all through the Model Context Protocol.

One MCP server. Ten tools. Your AI can now see your screen and interact with any application, just like you do.

What can it do?

  • See your screen — Take full or partial screenshots, auto-optimized for LLM token usage

  • Move & click — Navigate, click, double-click, right-click, drag and drop

  • Type anything — Full keyboard control including Unicode, emoji, and key combos (Cmd+C, Ctrl+Shift+T, etc.)

  • Cross-platform — Works on macOS, Windows, and Linux

Related MCP server: Bridge MCP

Tools

Tool

What it does

desktop_screenshot

Capture the screen or a region (returns image directly to the LLM)

desktop_get_screen_size

Get screen dimensions in logical pixels

desktop_get_mouse_position

Get current cursor coordinates

desktop_move_mouse

Move cursor (absolute or relative)

desktop_click

Click, double-click, or right-click at any position

desktop_scroll

Scroll up or down

desktop_drag

Drag from one position to another

desktop_type_text

Type text with full Unicode support

desktop_press_key

Press special keys (Enter, Tab, arrows, F1-F12, etc.)

desktop_hotkey

Press key combinations (Cmd+C, Ctrl+V, Alt+F4, etc.)

Quick Start

Install

git clone https://github.com/YOUR_USERNAME/mcp-desktop-controller.git
cd mcp-desktop-controller
pip install -e .

Add to Claude Desktop

Add to your config (~/Library/Application Support/Claude/claude_desktop_config.json):

{
  "mcpServers": {
    "desktop-controller": {
      "command": "mcp-desktop-controller"
    }
  }
}
{
  "mcpServers": {
    "desktop-controller": {
      "command": "/path/to/venv/bin/mcp-desktop-controller"
    }
  }
}

Add to Claude Code

claude mcp add desktop-controller -- mcp-desktop-controller

macOS Permissions

On first run, you'll need to grant two permissions in System Settings > Privacy & Security:

  1. Accessibility — so the server can control mouse and keyboard

  2. Screen Recording — so it can take screenshots

Safety

  • Failsafe — Move your mouse to the top-left corner (0,0) to instantly abort any action

  • Action pause — 0.1s delay between all actions to keep things predictable

  • Retina-aware — All coordinates use logical resolution; screenshots are auto-downscaled to save tokens

How it works

Built with FastMCP and PyAutoGUI. The server exposes desktop control as MCP tools over stdio. Any MCP-compatible client (Claude Desktop, Claude Code, or your own) connects and gets full desktop access.

Your AI  ←→  MCP Client  ←→  Desktop Controller  ←→  Your Screen

Platform Support

Platform

Status

Notes

macOS

Full support

Uses pbcopy for Unicode input

Windows

Full support

Uses clip for Unicode input

Linux

Full support

Requires xclip (sudo apt install xclip)

Development

# Run directly
python server.py

# Test with MCP Inspector
fastmcp dev server.py

License

MIT

This server cannot be deployed

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Maintenance

ActivityInactive
ResponsivenessNo issues

Resources

Related MCP Connectors

Related MCP Servers

  • openowl

    mihir-kanzariya
    A
    license
    Not graded
    quality
    B
    maintenance
    An MCP server that gives any AI assistant eyes and hands on your desktop — screenshots, clicking, typing, OCR, window management, accessibility-tree queries, workflow recording.
    5
    Apache 2.0

  • Bridge MCP

    BarhamAgha1
    A
    license
    Not graded
    quality
    D
    maintenance
    A Model Context Protocol server that gives any AI full control over a Windows PC, enabling application control, mouse/keyboard automation, screen capture, browser automation, and more.
    28 PyPI
    5
    MIT

  • puppet-ai

    transoff
    A
    license
    Not graded
    quality
    D
    maintenance
    Full computer control for AI agents on macOS — see, click, type, scroll via MCP. Works with any app, all processing on-device with PII protection.
    MIT