com-use-mcp
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
com-use-mcp
Computer-use MCP server for OpenCode: mouse, keyboard, screenshots, Windows OCR, window control and shell — so an AI agent can see and operate a Windows PC.
Built by Nanon + OpenCode (Muse Spark).
Windows only. Tested on Python 3.12.
How it works
com_server.pyexposes tools over MCP (stdio) usingFastMCP.com_use/actions.pyimplements everything: human-like mouse moves, bulk-paste typing, native-resolution screenshots, Windows built-in OCR (winocr) with x/y coordinates, contour-based UI element detection, color search, clipboard and window management via win32 APIs.The agent loop is:
look()(screenshot + OCR with coordinates) → decide →click/click_text/type_text/hotkey→ repeat.
Key accuracy decisions (v3):
Primary monitor only — captures can never drift to a secondary display.
Native 1:1 pixels — the screenshot the model sees is exactly the coordinate space it clicks in (
scale: 1.0), so no mental rescaling error.Text-grounded clicks —
click_text()resolves OCR word centers in code instead of guessing pixels.DPI aware — coordinates match real pixels on 125%/150% scaling.
Related MCP server: jenny-mcp-server
Install
pip install -r requirements.txtOpenCode config
Copy opencode.json.example to your project as opencode.json and fix the path to com_server.py:
{
"$schema": "https://opencode.ai/config.json",
"mcp": {
"com-use": {
"type": "local",
"command": ["python", "C:\\path\\to\\com-use-mcp\\com_server.py"],
"enabled": true,
"timeout": 30000
}
}
}The 30s timeout matters: the first import (cv2, numpy, …) is slow and a short timeout kills the server before it is ready.
Tools
Mouse: click, double_click, right_click, mouse_move, drag, scroll, mouse_position
Keyboard: type_text (bulk paste), press_key, hotkey, key_hold
Screen: look (screenshot + OCR, primary tool), screenshot, screen_size, ocr
Grounding: ground_text (exact center of text), click_text (ground + click, preferred for buttons)
Detection: find_elements, find_color
Clipboard: get_clipboard, set_clipboard
Windows: list_windows, active_window, focus_window, close_window
Shell: run_command, open_app, open_url, wait
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
Connect ChatGPT, Claude, Cursor or VS Code to your Windows PC: files, terminal, browser, apps.
Connect AI assistants to your approved computer for files, commands, browser and desktop tasks.
Real desktops for AI agents, on machines you choose: screenshot, type, click, hire more agents.
Eyes and hands on real Windows PCs — observe, click, type via Glasswarp API.
Related MCP Servers
- AlicenseNot gradedqualityCmaintenanceEnables comprehensive Windows desktop automation including screen capture, OCR text extraction, mouse/keyboard control, window management, process control, and clipboard operations through 25+ tools for AI agents.38 PyPI8MIT
- FlicenseNot gradedqualityDmaintenanceEnables AI agents to interact with the Windows desktop environment, including browser control, clipboard, file management, GitHub, Roblox Studio, OCR, and more, with a privileged approval system for risky actions.-
- FlicenseNot gradedqualityDmaintenanceEnables AI agents to control Windows GUI applications like a human using screen capture, OCR, mouse and keyboard input, and window management, with safety levels and memory.-
- AlicenseNot gradedqualityDmaintenanceEnables AI agents to interact with the Windows operating system, performing tasks such as file navigation, application control, UI interaction, and QA testing.MIT