Yunkai Desktop Bridge

A local-first Windows MCP bridge for guarded desktop perception and interaction.

This repository is a sanitized public-source export of the DesktopBridge used in the Yunkai project. It intentionally keeps the safety boundaries that matter: semantic/read-only inspection first, bounded input actions, local runtime policy, deterministic verification, metadata-only action audit, and no arbitrary shell.

Highlights

• Windows virtual-desktop and active-window screenshots

• Microsoft UI Automation (UIA) semantic inspection

• Win32 control fallback

• guarded mouse and keyboard input

• verified UIA click/text actions with expected-post predicates

• bounded game-input mode behind a separate local permission tier

• localhost-only optional vision fallback

• local DPAPI-backed secret aliases; secret values are never accepted as remote MCP arguments

• capability manifest, runtime permission state, routing hints, device snapshot, and action trace surfaces

Related MCP server: dsh-desktop-operator

Deliberate non-capabilities

The public MCP surface does not expose arbitrary shell/PowerShell/cmd execution, file deletion, software uninstall, shutdown/reboot, registry modification, unrestricted process kill, or remote secret upload.

Public export boundary

This repository does not contain private tunnel IDs, runtime credentials, owner-specific configuration, caches, backups, local verification evidence, or tunnel-client binaries. Secure-tunnel/autostart wrappers from the private workspace are also omitted from this first public source release.

The shared contract modules required by the bridge are included under yunkai_shared/.

Requirements

• Windows 10/11

• Python 3.11+

• Microsoft UI Automation (built into Windows)

• Python dependencies in requirements.txt

Quick start

git clone https://github.com/YunkaiLim/yunkai-desktop-bridge.git
cd yunkai-desktop-bridge
py -m venv .venv
.\.venv\Scripts\Activate.ps1
pip install -r requirements.txt
cd DesktopBridge
python server_stdio.py

For the local HTTP entry point used by the original bridge:

cd DesktopBridge
python server.py

Optional localhost vision can be configured by copying DesktopBridge/desktopbridge_vision.example.json to desktopbridge_vision.json and selecting a compatible local vision model.

Tests

From DesktopBridge/:

python -m unittest

The selected source mirrors the private working tree at publication time. Run the included unit suite in your target Windows environment; this public repository is a source export, not a claim that every Windows build or MCP host has been acceptance-tested.

Security model

Read SECURITY.md before enabling side-effecting tools. Keep runtime permissions local, preserve foreground-window and semantic-target guards, and do not remove verification to reduce latency.

License

Apache-2.0. See LICENSE and NOTICE.

This project is independent source code and is not an official OpenAI product.