Skip to main content
Glama
Akicou

localScreenControl

by Akicou

localScreenControl

An MCP server that lets an AI assistant see and control your local desktop.

Tool

What it does

screenshot(monitor=1, max_width=1600)

Screenshot of a monitor (1 = primary, 0 = all), downscaled to max_width

click(x, y, button="left", clicks=1)

Click at a pixel of the last screenshot (clicks=2 = double-click)

scroll(x, y, amount=-5)

Mouse wheel at a point (negative = down)

press_keys(keys)

Key combos like ctrl+tab, alt+f4, ctrl+shift+t, enter

type_text(text, paste=True)

Enter text in the focused field, via clipboard paste (default) or real keystrokes

get_clipboard() / set_clipboard(text)

Read / write clipboard text (ctrl+a, ctrl+c, get_clipboard reads a whole page)

wait_until_stable(timeout_ms=5000)

Wait until the screen stops changing (page loads, dialogs, animations)

batch(steps, screenshot_after=True)

Run many actions in one call, then return a screenshot

batch example:

[{"action": "click", "x": 700, "y": 140},
 {"action": "type", "text": "Hello"},
 {"action": "keys", "keys": "enter"},
 {"action": "settle"},
 {"action": "wait", "ms": 300}]

Works on Windows and Linux (X11). Requires Python 3.10+.

Setup

Windows (PowerShell)

git clone https://github.com/Akicou/localScreenControl
cd localScreenControl
powershell -ExecutionPolicy Bypass -File .\setup.ps1

Linux

git clone https://github.com/Akicou/localScreenControl
cd localScreenControl
./setup.sh

The script creates a .venv, installs dependencies, registers the server with Claude Code (if claude is on your PATH) and prints a JSON config snippet for other MCP clients such as Claude Desktop.

Related MCP server: screenmcp-claude-plugin

Notes

  • Coordinates are pixels of the most recent screenshot image. The server maps them back to the real screen (downscaling, DPI, monitor offset), so they always match what the AI saw.

  • Linux clipboard needs xclip or xsel (sudo apt install xclip).

  • Self-check: .venv/bin/python test_server.py (or .venv\Scripts\python test_server.py).

  • Linux on Wayland: only X11/XWayland windows can be captured/controlled. Use an X11 session for full control.

  • Key names follow pynput's Key (ctrl, shift, alt, cmd/win, tab, enter, esc, f1–f20, up, page_down, ...).

Security

This server gives the connected AI full control over your mouse and keyboard. Only connect it to clients you trust.

License

MIT

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI agents to see and control your desktop with tools for screenshots, clicks, typing, and more, all locally on macOS and Windows.
    59 npm
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to control remote desktops through screen capture, mouse movement, and keyboard input.
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to observe and control the user's live desktop by listing apps, reading accessibility trees, and performing clicks, typing, scrolling, dragging, and other input actions with per-action approvals and local audit archives.
    1
    MIT