Skip to main content
Glama
rotcev

Harness

by rotcev
OverviewSchemaSourceRelated ServersDiscussionsAdmin
Python
Remote

xRDP Agent Harness

Give your AI agent control of your Linux desktop.

Screenshots, mouse clicks, scrolling, typing and keyboard shortcuts—across browsers, terminals, file managers and other desktop apps.

Works with Codex and other compatible MCP clients, with a CLI included. Connects over SSH to your existing X11 desktop. No changes to xrdp required.

Terminal running hello from Harness

Install with your agent

Copy and paste this into your agent:

Install https://github.com/rotcev/xrdp-agent-harness and connect it to my desktop.

Ask me only how I normally connect over SSH: my SSH alias or connection command,
plus a local key-file path if needed. Never ask for passwords or private key contents.
Discover the OS, desktop session and other settings yourself. Ask a follow-up only
if something is missing or there is more than one desktop to choose from.

Read the repo's setup instructions. Install locally in ~/tools/xrdp-agent-harness
using a virtual environment, install any missing remote dependencies, and register
MCP in this agent's client if supported. Keep my connection config outside the repo
at ~/.config/xrdp-agent-harness/config.toml with private permissions. Preserve any
existing setup and use strict SSH host verification; ask me to verify an unknown host.

Enable mouse and keyboard control, then capture a screenshot to verify the connection.
Don't restart or log out my desktop. Finish with a short result and any reload step
needed. If this client doesn't support MCP, set up the CLI instead.

You need a macOS or Linux computer and an existing Linux X11 desktop with SSH access. Ubuntu with xrdp and XFCE is the tested setup. Python 3.11+, Git and SSH are required locally; the agent can check dependencies for you.

Related MCP server: VNC MCP Server

Use it

Open a new terminal on my desktop, type echo hello from Harness, press Enter, and show me the result.

Or:

Take a screenshot of my desktop without changing anything.

Install manually

git clone https://github.com/rotcev/xrdp-agent-harness.git
cd xrdp-agent-harness
python3 -m venv .venv
.venv/bin/python -m pip install .

Then follow the connection setup guide.

Good to know

  • Uses your own SSH access. Keep keys and private configuration out of the repo.

  • Controls apps as the logged-in desktop user. Use a trusted agent and one controller at a time.

  • Experimental v0.1.0. Windows and Wayland desktops aren't supported. No drag-and-drop, clipboard transfer or automatic session recovery yet.

Documentation · Security · Contributing · MIT License

This server cannot be deployed

One endpoint for every MCP toolRayrun runs every MCP server behind one URL and holds the credentials. Each call is decided per client, tool, and argument, then recorded.ray.runAd

Maintenance

ActivityMaintained
ResponsivenessNo issues

Resources

Related MCP Connectors

Related MCP Servers

  • Ubuntu VM Control

    ltcg-addict
    F
    license
    Not graded
    quality
    D
    maintenance
    Enables AI assistants to interact with Ubuntu VMs via SSH, including executing commands, simulating keyboard/mouse input, capturing screenshots, and controlling GUI applications remotely.
    1
    -

  • VNC MCP Server

    volkan-m
    A
    license
    B
    quality
    D
    maintenance
    Empowers AI agents to see, reason, and control computers via VNC, providing advanced vision features like OCR and image search, human-like input control, and optional SSH remote command execution.
    21
    1
    MIT

  • linux-computer-use

    tak-uukti
    A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to control Linux/X11 desktops by providing tools for taking screenshots, clicking, typing, and managing windows via AT-SPI and xdotool.
    3
    MIT

  • astra-linux-agent

    novique-ai
    A
    license
    Not graded
    quality
    D
    maintenance
    Enables an AI agent to see and control a Linux desktop via Wayland/Hyprland, providing screenshots, structured desktop state, pointer/keyboard input, semantic window/workspace tools, and a policy engine for safe execution.
    Apache 2.0