Skip to main content
Glama
Sign In
windows-computer-use-mcp

windows-computer-use-mcp

by KonnectSuite
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Local

windows-computer-use-mcp

A tool for agents, and an agent itself.

You

It

Use it as an MCP server

Claude, Cursor, DeepSeek call automation_click, automation_screenshot, automation_ocr — 22 tools

Use it as an autonomous agent

Give it a goal: automation_mission(run="install app, verify UI, screenshot result") — it plans, executes, retries, and reports

Use it as a webapp

start.ps1 opens a React dashboard at http://127.0.0.1:10788 with HITL, crawler, logging

Use it as a desktop app

The NSIS installer bundles everything into one binary — no Python, no uv, no git needed

Exhibit A: 100 Tauri/NSIS installers, one unattended run, $2 in LLM costs. Install, screenshot, verify, report — zero human intervention. That is what agentic Windows automation looks like at scale.

Built on pywinauto. Read docs/SAFETY.md before production use.

Quick Start

Method

Command / Config

MCP stdio (Cursor, Claude Desktop)

{ "mcpServers": { "windows-computer-use": { "command": "uv", "args": ["--directory", "<PATH>", "run", "windows-computer-use-mcp"] } } }

HTTP streamable (any MCP HTTP client)

{ "mcpServers": { "windows-computer-use": { "url": "http://127.0.0.1:10789/mcp" } } }

Web operator UI

.\start.ps1 → http://127.0.0.1:10788

Desktop app (NSIS installer)

Download from Releases — zero deps

See INSTALL.md for detailed setup. Run just demo for examples.

Related MCP server: PointHand

Features

  • Window Management — find, activate, maximize, minimize, position, close

  • Mouse & Keyboard — click, drag, type, hotkeys, app shortcuts

  • UI Elements — inspect, click, read text, verify state via UIA / Win32

  • Visual Intelligence — screenshots, OCR, template matching

  • Autonomous Missions — give it a goal, it plans and executes with retry + verification

  • Macro Recording — record any UI sequence, replay, verify outcomes

  • Multi-App Workflows — chain actions across Notepad, Calc, Paint, or any Windows app

  • Telemetry — every action logged to SQLite; query failure patterns by tool

  • Adaptive Location — auto-cascades through title/auto_id/control_id/class/OCR to find elements

  • Face Recognition — optional, off by default

Documentation

Doc

Content

INSTALL.md

Setup: desktop app, uv, MCP config

docs/README.md

Full documentation hub

docs/py-stack.md

Python dependency deep dive

docs/composing-with-playwright.md

Browser automation with Playwright MCP

docs/ocr.md

OCR system — Tesseract setup, limitations, competition

docs/cua-nsis-certification.md

Dogfooding: using the tool to test its own NSIS installer

docs/ROADMAP.md

Improvement roadmap short/medium/long term

docs/SAFETY.md

HITL, kill switch, opt-in features

docs/TOOLS.md

Portmanteau tool reference

tests/README.md

Test suite guide and e2e setup

examples/README.md

Runnable demos

mcpb/README.md

MCPB bundle packaging

web_sota/README.md

Operator UI build/dev guide

CHANGELOG.md

Release history

Ports

Port

Service

10788

Frontend — Vite operator UI

10789

Backend — FastAPI + FastMCP HTTP

stdio

MCP transport (port-free)

Related

Repo

What it does

autohotkey-mcp

Raw input recording/replay via AHK

browser-mcp

Playwright browser control — for webapps, HTML DOM, websites

virtualization-mcp

Sandbox / VM isolation

windows-operations-mcp

Registry, services, accounts

Browser vs desktop: This server drives Win32 / UI Automation. For HTML/DOM and websites, pair with browser-mcp (Playwright). Both MCPs can run side by side — use one profile that loads both and let the LLM pick the right tool for the target.

Fleet standards: mcp-central-docs.

License

MIT — Copyright (c) 2026 Sandra Schipal.

This server cannot be deployed

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Resources

Related MCP Connectors

Related MCP Servers

  • OmniFlow

    huppugo1
    A
    license
    Not graded
    quality
    D
    maintenance
    Enables AI clients to automate Windows desktop applications through window manipulation, image recognition, OCR, keyboard/mouse simulation, and memory operations via the MCP protocol.
    MIT

  • PointHand

    ayzekhdawy
    A
    license
    Not graded
    quality
    B
    maintenance
    Enables AI agents to see and operate Windows applications through MCP, including windows, screenshots, mouse, keyboard, scrolling, UI Automation, clipboard, and freehand or geometric drawing. Supports supervised creative workflows with native Win32 input, screenshots, allow-listed apps, and an idle safety guard.
    1
    MIT

  • Windows-Use MCP Server

    kultur-512
    A
    license
    Not graded
    quality
    C
    maintenance
    Enables MCP clients to observe and control the Windows desktop through the UI Automation accessibility tree — no vision model required — by exposing tools for reading windows and interactive elements, clicking, typing, scrolling, shortcuts, PowerShell, screenshots, virtual desktops, web scraping, file operations and persistent memory, including background-window control without stealing focus. An optional agent mode adds a single natural-language task tool that runs the full upstream agent loop when an LLM provider is configured.
    1
    MIT

  • codex-cua-mcp

    osamabinabsar
    A
    license
    Not graded
    quality
    B
    maintenance
    Enables MCP agents to drive Windows applications by targeting individual windows—clicking, typing, scrolling, dragging, and reading accessibility trees or screenshots—without stealing the user's focus, mouse, or keyboard. Runs entirely locally alongside the user, with per-app approval and no cloud account or usage limits.
    MIT