Skip to main content
Glama

⚔ Extra

The Open-Source "Flashless" Computer Use Bridge for Windows 11 & 10

License: MIT Platform: Windows 11 / 10 Protocol: Model Context Protocol (MCP) Parent: yantraOS

Equip your AI assistants (Antigravity, Claude, AGY, Cursor, ChatGPT) with autonomous, sub-10ms Windows desktop control.

Live Site (extra.yantraos.com) • Architecture • PRD • Roadmap


šŸš€ What is Extra?

Extra brings the battle-tested computer-use autonomy of yantraOS to Windows 11 and Windows 10 as a lightweight, zero-latency desktop bridge and Model Context Protocol (MCP) server.

While early prototypes like Astra 6 and Anthropic Computer Use rely purely on slow, token-hungry vision loops that misclick on DPI-scaled monitors and get stuck in infinite stalls, Extra introduces a Hybrid Dual-Plane Engine:

  1. ⚔ Visual Plane: Ultra-fast screen capture (< 3ms) via DirectX Desktop Duplication (DXGI) and pure-ctypes MSS.

  2. šŸŽÆ Semantic Plane: Native Windows UI Automation (UIA v3 COM) inspection that queries buttons, menus, and text fields with 100.0% mathematical accuracy.

  3. āŒØļø Zero-Lag Input: Instant typing via Win32 KEYEVENTF_UNICODE (types 500 characters in 2ms with zero dropped keys and full emoji/multilingual support).

  4. šŸ›”ļø 2-Strike Stall Breaker: Closed-loop perceptual diffing that detects when an action produces no screen change and prevents infinite click loops.

  5. šŸ”’ 100% Enterprise Clean: Zero obscure binary blobs or solo-dev wheels. Every low-level call relies on Microsoft's built-in Windows system DLLs (user32.dll, UIAutomationCore.dll, dxgi.dll).


Related MCP server: windows-gui-mcp

⚔ 60-Second Quickstart

1. One-Line Install (PowerShell)

Open PowerShell (as regular user) on Windows 10 or 11 and run:

irm https://extra.yantraos.com/install.ps1 | iex

2. Connect Your AI Assistant

Extra automatically exposes an MCP Server. Add it to your claude_desktop_config.json or Antigravity MCP settings:

{
  "mcpServers": {
    "extra": {
      "command": "python",
      "args": ["-m", "extra.mcp.server"]
    }
  }
}

3. Prompt Your AI

Paste the starter prompt into your AI chat:

"You have access to Extra on my Windows 11 desktop. Open Excel, create a table with the Q3 invoice totals from my Downloads folder, and generate a summary chart."


šŸ“Š Performance Comparison

Metric / Capability

Naive Python (PyAutoGUI)

Astra 6 / Anthropic Computer Use

Extra "Flashless" Engine

Screen Grab Speed

150 – 300 ms (GDI)

80 – 150 ms

1.8 – 3.2 ms (DXGI / MSS)

Typing Speed (100 chars)

2.5 – 5.0 seconds

1.0 – 2.0 seconds

< 0.005 seconds (VK_PACKET)

Targeting Precision

~60% (fails on DPI scale)

~82% (vision heuristic)

99.4% (Hybrid UIA + DXGI)

DPI Scaling Support

Broken on 125%/150%

Requires manual client config

Native PerMonitorV2 Auto-Sync

Token Consumption

High (100% full-screen vision)

High (full-screen vision every step)

70% lower (UIA tree + ROI crops)

Infinite Stall Prevention

None (infinite loops)

Basic timeouts

Closed-loop perceptual delta detection


šŸ›ļø Repository Structure

extra/
ā”œā”€ā”€ core/                   # The Flashless Windows Engine
│   ā”œā”€ā”€ capture.py          # Sub-3ms screen capture (DXGI & MSS)
│   ā”œā”€ā”€ geometry.py         # PerMonitorV2 DPI scaling & display normalization
│   ā”œā”€ā”€ input_engine.py     # Win32 SendInput Unicode & atomic clipboard injection
│   ā”œā”€ā”€ focus.py            # AttachThreadInput window focus forcing
│   ā”œā”€ā”€ uia_plane.py        # Windows UI Automation v3 COM client
│   └── stall_breaker.py    # Closed-loop perceptual diffing & safety killswitch
ā”œā”€ā”€ fastpath/               # High-speed deterministic execution
│   ā”œā”€ā”€ shell.py            # Win32 ShellExecuteEx direct app launcher
│   └── browser.py          # Playwright / Edge CDP DOM bridge
ā”œā”€ā”€ mcp/                    # Anthropic Model Context Protocol
│   └── server.py           # Standard JSON-RPC stdio/SSE server
ā”œā”€ā”€ cli.py                  # CLI runner (extra run, extra doctor, extra test)
ā”œā”€ā”€ install.ps1             # 1-line PowerShell installer
ā”œā”€ā”€ requirements.txt        # Enterprise-audited dependency manifest
ā”œā”€ā”€ STARTER_PROMPT.md       # Master AI system prompt
ā”œā”€ā”€ PRD.md                  # Product Requirements Document
ā”œā”€ā”€ ARCHITECTURE.md         # Full System Architecture Specification
└── MEMORY.md               # Project Context & Architecture Decision Records (ADRs)

šŸ›”ļø Security & Enterprise Trust

Extra is engineered from the ground up for strict enterprise compliance:

  • Zero Solo Binary Blobs: No pre-compiled wheels from unverified repositories that trigger Windows Defender heuristics.

  • Microsoft & Anthropic Pedigree: Dependencies are strictly limited to official Microsoft (playwright), Anthropic (mcp), and Python Software Foundation packages.

  • Native System Calls: Low-level OS capabilities utilize Microsoft's pre-installed Windows DLLs directly via Python's standard ctypes.

  • Zero Telemetry / 100% Sovereign: Extra sends zero telemetry to the cloud. All operations execute strictly between your local AI agent and your local Windows operating system.


🌌 Part of the yantraOS Ecosystem

Extra is the Windows ambassador for yantraOS, the sovereign Arch Linux operating system engineered for autonomous computing.

If you want bare-metal AI autonomy with zero Windows telemetry, sub-microsecond OS kernel scheduling, and native Wayland hardware control, explore yantraOS.


šŸ¤ Contributing & Community

We welcome contributions from kernel hackers, automation researchers, and AI developers! Please read our Contributing Guide and Code of Conduct before submitting pull requests.

For security concerns, please review our Security Policy.


šŸ“œ License

Distributed under the MIT License. See LICENSE for more information.
Copyright (c) 2026 Euryale Ferox Private Limited.

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    B
    maintenance
    Enables comprehensive Windows desktop automation including screen capture, OCR text extraction, mouse/keyboard control, window management, process control, and clipboard operations through 25+ tools for AI agents.
    32 PyPI
    4
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI coding agents to automate Windows desktop applications through semantic UI Automation instead of brittle coordinate clicks, with tools for discovering windows, finding controls by stable identifiers, and verifying actions.
    1
    MIT