Skip to main content
Glama
mikesmullin

computer-use

by mikesmullin

mcp-computer-use

AwesomeWM + X11 computer-use MCP for Ada. Beginning of a desktop-control surface: window geometry on a multi-monitor Awesome setup, plus screenshot, type, and click.

Coordinates are global (one system across all screens). screen is Awesome's 1-based index so Ada can place a window on a specific monitor. Fullscreen uses Awesome client.fullscreen, not a fake maximize.

Typing uses xdotool type (XTEST), the same injection path as /workspace/whisper (pynput XTEST / vk keysyms). GTK4 apps discard XSendEvent.

Tools

Tool

Notes

window_list

screens + windows (class=zen for the browser)

window_info

one window's x,y,w,h,screen,fullscreen

window_move

global x,y or screen + workarea-relative x,y

window_resize

width/height

window_fullscreen

on true/false or toggle

window_screenshot

image of that X window

cursor_position

current pointer x,y (global) + window under cursor

window_type

type text (max 4000 chars)

window_click

click x,y relative to the window

Related MCP server: linux-computer-use

Run

cd /workspace/mcp-computer-use && bun install
bun server.coffee

Ada loads this as MCP computer-use (prefix: false). Requires awesome-client, xdotool, scrot, and a working DISPLAY.

Related MCP Connectors

Related MCP Servers

  • F
    license
    A
    quality
    D
    maintenance
    Enables Claude Code to interact with Linux X11 desktops by performing mouse actions, keyboard input, and capturing screenshots. It provides a suite of tools for automation tasks such as clicking, typing, and zooming on specific screen regions.
    16
    -
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to control Linux/X11 desktops by providing tools for taking screenshots, clicking, typing, and managing windows via AT-SPI and xdotool.
    3
    MIT
  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables coding agents to control other application windows by providing primitives for clicking, typing, capturing screenshots, and window management. Supports macOS, Windows, and Linux.
    MIT