@zcode-community/mcp-server
Enables AI agents to inspect and operate native macOS desktop applications in the background using the macOS Accessibility API and CoreGraphics. It provides tools for listing apps and windows, reading app state, clicking elements, setting values, performing accessibility actions, launching applications, taking screenshots, managing clipboard content, and handling file dialogs without stealing focus.
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
Zov Computer Use
Turnkey Cross-Platform Desktop Computer Use Skills + Dual-Native Accessibility/UIA MCP Server (zov-cua) for AI coding agents (Antigravity, Claude Code, Cursor, Qoder, and any MCP-compatible host) on macOS 13+ and Windows 10/11.
Clone once, run ./install.sh (macOS) or .\install.ps1 / install.cmd (Windows), and your agent can inspect and operate native desktop applications in the background without stealing your mouse cursor or window focus.
What You Get Out of the Box
Two Production Agent Skills (
skills/)computer-use-orchestrator: High-level routing discipline—semantic Accessibility / UI Automation first, background zero-focus execution, single-writer window ownership, safe background window closing, and fail-closed recovery.zov-computer-use: Concrete execution loop (Observe → Act → Verify), GOOD/DEGRADED/FAILED state triage, single-roundtrip atomicreturn_state="compact"updates, native macOS (⌘⇧G) & Windows Open/Save dialog handling, destructive action guards, and a zero-dependency read-only verifier (scripts/rpc_probe.py).
Self-Contained Dual-Native MCP Server (
packages/,zov-cua)macOS Native Engine (
macos-ax-helper): Compiled locally via/usr/bin/swiftc(ApplicationServices+CoreGraphics). Deep AX tree capture (~100ms typical), zero-focus backgroundAXPress+AXValue, Qt6/WebEngine occlusion-verified fallback, andCGEvent.postToPidbackground keys.Windows Native Engine (
windows-uia-helper.exe): Compiled locally via Windows built-in.NET Framework 4.xcsc.exe(UIAutomationClient+ Win32user32.dll/gdi32.dll/shcore.dll, Per-Monitor DPI v2). Zero PowerShell cold-start or shell injection—supports background zero-focusInvokePattern,ValuePattern.SetValue,TogglePattern,SelectionItemPattern, offscreenPrintWindow(PW_RENDERFULLCONTENT)window screenshots,WindowFromPointocclusion checks, and UnicodeSendInput.47 Standardized Tools:
list_apps,list_windows,get_app_state,left_click/click,set_value,perform_action,open_application/launch_app,screenshot,request_access,stop_computer_control, clipboard tools, and compact/diff context compression with automatic password redaction ([REDACTED_PASSWORD]).
Related MCP server: macos-desktop-control
Quick Start
macOS (13+)
Prerequisites: Node.js >= 20, Xcode Command Line Tools (
xcode-select --install)
git clone https://github.com/timexingxin/zov-computer-use.git
cd zov-computer-use
./install.shThen enable System Settings → Privacy & Security → Accessibility (and Screen Recording for screenshots) for your host app.
Windows (10 / 11)
Prerequisites: Node.js >= 20, Python 3.9+ (optional, for post-install
rpc_probe.py;.NET Framework 4.x csc.exeis pre-installed inC:\Windows\Microsoft.NET\Framework64\v4.0.30319)
git clone https://github.com/timexingxin/zov-computer-use.git
cd zov-computer-use
.\install.ps1(Or run install.cmd from cmd.exe.) Restart your agent client to load zov-cua.
Installer Options
# macOS: ./install.sh [options] | Windows: .\install.ps1 [options]
--client <auto|antigravity|claude|cursor|qoder|all> # Target specific agent client(s)
--preserve-skills # Upgrade runtime without overwriting customized SKILL.md
--dry-run # Preview changes without writing files
--skip-probe # Skip Python post-install stdio probe
--uninstall # Cleanly remove kit-owned skills, runtime & zov-cua entriesArchitecture
flowchart TD
Agent["AI Agent (Antigravity / Claude Code / Cursor / Qoder)"]
Orch["Skill: computer-use-orchestrator<br/>(Routing, Single-Writer & Focus Safety)"]
Exec["Skill: zov-computer-use<br/>(Observe -> Act -> Verify Loop)"]
Agent --> Orch --> Exec
Exec -->|"Stdio JSON-RPC 2.0"| ZovMCP["Zov Computer Use MCP Server<br/>(@zov/mcp-server, zov-cua)"]
ZovMCP -->|"darwin"| MacAX["macOS Native Swift Helper (macos-ax-helper)<br/>ApplicationServices (AX) & CoreGraphics"]
ZovMCP -->|"win32"| WinUIA["Windows Native C# Helper (windows-uia-helper.exe)<br/>UI Automation + Win32 PrintWindow / SendInput"]Verification & Diagnostics
# Run built-in CLI environment doctor
npm run doctor
# Run full unit, protocol, native golden, adversarial & installer E2E test suite
npm testSecurity & Safety Design
Background-First, Focus-Safe: Semantic AX/UIA actions (
click,set_value,perform_action) act directly on element patterns with secondary TOCTOU checks, without moving the physical pointer or stealing foreground focus.Zero Shell / Zero Injection: Both
macos-ax-helperandwindows-uia-helper.exeare invoked strictly viachild_process.spawn(exe, argvArray)with zero PowerShell or shell string interpolation.Zero Fake-Success Policy: Runtime schema validation, strict modifier whitelists, and structured error codes (
unsupported_platform,stale_handle,ambiguous_element,window_not_found,foreground_required,permission_denied,timeout).Timeout Replay Guard: Mutating timeouts report
action_sent: trueso agents re-observe rather than replaying partial clicks or keystrokes.Main-Agent Serialization & Kill Switch: Cooperative subagent guard (
SUBAGENT_COMPUTER_USE_UNAVAILABLE) and session-levelstop_computer_controlreleasing tracked held inputs.
License & Disclaimer
Licensed under the Apache License 2.0. See NOTICE for attribution and third-party trademark disclosures. No proprietary binaries are bundled in this repository.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
Connect AI assistants to your approved computer for files, commands, browser and desktop tasks.
Let your AI agent control real iPhones: screenshots, tap, swipe, type and open apps.
Operate Linux, macOS and Windows from your LLM. Every action runs through an auditable allowlist.
Mac & Windows: let ChatGPT, Claude & Cursor use your email, calendar, iMessage, Teams, files.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables AI assistants to automate macOS desktop tasks including mouse control, keyboard input, screenshots, window management, and UI interaction.417MIT
- AlicenseNot gradedqualityDmaintenanceProvides native macOS desktop automation for AI agents, enabling screen capture, mouse/keyboard control, window management, and iOS/Android simulator control in both foreground and background modes without focus stealing.6MIT
- AlicenseNot gradedqualityCmaintenanceEnables AI agents to control macOS applications through the Accessibility API, AppleScript, and CGEvents, providing structured text output of UI elements and actions without needing screenshots.MIT
- AlicenseAqualityDmaintenanceEnables AI agents to control macOS desktop apps via screenshots, mouse clicks, keyboard input, accessibility queries, and AppleScript.118 npmMIT