Skip to main content
Glama
spencerkinney

Computer Use

Computer Use MCP Server 🖥️

Control virtual computers through the Model Context Protocol (MCP). Built with FastMCP and Orgo.

Spin up cloud desktop environments for Computer Use Agents (CUA).

Quick Start

1. Install Dependencies

# Create virtual environment
python3 -m venv mcp-env
source mcp-env/bin/activate

# Install packages
pip install fastmcp pydantic orgo

2. Get API Keys

3. Run Server

# Set environment variables
export ORGO_API_KEY="your_orgo_key"
export ANTHROPIC_API_KEY="your_anthropic_key"

# Start server
python computer_mcp_server.py

Server runs on http://127.0.0.1:9000

Related MCP server: codex-cua-mcp

Test Client

import asyncio
from fastmcp import Client

async def demo():
    async with Client("http://127.0.0.1:9000/mcp") as client:
        # Initialize computer
        result = await client.call_tool("initialize_computer", {
            "api_key": "your_orgo_key"
        })
        print(f"Computer ready: {result[0].text}")
        
        # Take screenshot
        screenshot = await client.call_tool("get_screenshot")
        print("Screenshot taken!")
        
        # Click and type
        await client.call_tool("left_click", {"x": 100, "y": 200})
        await client.call_tool("type_text", {"text": "Hello World"})
        await client.call_tool("press_key", {"key": "Enter"})

if __name__ == "__main__":
    asyncio.run(demo())

Available Tools

Tool

Description

initialize_computer

Start virtual computer

get_screenshot

Take screen capture

left_click, right_click, double_click

Mouse actions

scroll

Scroll up/down

type_text, press_key

Keyboard input

wait

Wait for specified seconds

execute_bash

Run terminal commands

restart_computer, shutdown_computer

Computer lifecycle

get_status, list_sessions

Status and session management

prompt

Claude AI Computer Use

Claude AI Computer Use Example

# Let Claude control the computer
await client.call_tool("prompt", {
    "instruction": "Open Firefox and go to google.com"
})

Requirements

  • Python 3.8+

  • Orgo API key

  • Anthropic API key (for Claude CUA)

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables local macOS computer use by letting agents click, type, and inspect accessibility trees without stealing focus, through an unofficial host for OpenAI Computer Use.
    MIT