-
securityA
license-
qualityAn MCP server that bridges AI agents with GUI automation capabilities, allowing them to control mouse, keyboard, windows, and take screenshots to interact with desktop applications.
Last updated -
10
MIT License
Enables cross-platform GUI automation on Linux systems, allowing control of mouse and keyboard input and screen operations
Enables cross-platform GUI automation on macOS systems, allowing control of mouse and keyboard input and screen operations
Supports launching the MCP Inspector via npm for debugging the server's operations
Allows publishing the server package to PyPI for easy installation
Built on Python with PyAutoGUI to provide GUI testing and control capabilities
mcp-pyautogui-server
A MCP (Model Context Protocol) server that provides automated GUI testing and control capabilities through PyAutoGUI.
Features
Control mouse movements and clicks
Simulate keyboard input
Take screenshots
Find images on screen
Get screen information
Cross-platform support (Windows, macOS, Linux)
Tools
The server implements the following tools:
Mouse Control
Move mouse to specific coordinates
Click at current or specified position
Drag and drop operations
Get current mouse position
Keyboard Control
Type text
Press individual keys
Hotkey combinations
Screen Operations
Take screenshots
Get screen size
Find image locations on screen
Get pixel colors
Installation
Prerequisites
Python 3.12+
PyAutoGUI
Other dependencies will be installed automatically
Install Steps
Install the package:
pip install mcp-pyautogui-server
Claude Desktop Configuration
On MacOS:
~/Library/Application\ Support/Claude/claude_desktop_config.json
On Windows:
%APPDATA%/Claude/claude_desktop_config.json
Development/Unpublished Servers Configuration:
{
"mcpServers": {
"mcp-pyautogui-server": {
"command": "uv",
"args": [
"--directory",
"/path/to/mcp-pyautogui-server",
"run",
"mcp-pyautogui-server"
]
}
}
}
Published Servers Configuration:
{
"mcpServers": {
"mcp-pyautogui-server": {
"command": "uvx",
"args": [
"mcp-pyautogui-server"
]
}
}
}
Development
Building and Publishing
Sync dependencies and update lockfile:
uv sync
Build package distributions:
uv build
Publish to PyPI:
uv publish
Note: Set PyPI credentials via environment variables or command flags:
Token:
--tokenorUV_PUBLISH_TOKENUsername/password:
--username/UV_PUBLISH_USERNAMEand--password/UV_PUBLISH_PASSWORD
Debugging
For the best debugging experience, use the MCP Inspector.
Launch the MCP Inspector via npm:
npx @modelcontextprotocol/inspector uv --directory /path/to/mcp-pyautogui-server run mcp-pyautogui-server
The Inspector will display a URL that you can access in your browser to begin debugging.
License
This project is licensed under the MIT License - see the LICENSE file for details.
This server cannot be installed
local-only server
The server can only run on the client's local machine because it depends on local resources.
Provides automated GUI testing and control capabilities through an MCP server that enables mouse movements, keyboard input, screen captures, and image recognition across Windows, macOS, and Linux.
Related MCP Servers
- -securityAlicense-qualityMCP server that provides computer control capabilities including mouse movements, keyboard actions, screenshot capture with OCR, and window management through a unified API.Last updated -47MIT License
- AsecurityAlicenseAqualityA powerful MCP server that provides interactive user feedback and command execution capabilities for AI-assisted development, featuring a graphical interface with text and image support.Last updated -139MIT License
- -securityFlicense-qualityAn MCP server that allows AI tools like Claude Desktop, Claude Code, and Cursor to visually interact with macOS applications by capturing screenshots and controlling the mouse and keyboard.Last updated -5