agy_computer_use.mcp_server
Server Configuration
Describes the environment variables required to run the server.
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||
Instructions
Guidance the server publishes about itself, which clients place ahead of the tool catalog so the model reads it before choosing anything.
This server publishes no instructions, or was last inspected before Glama recorded them.
Capabilities
Features and capabilities supported by this server
Protocol revision2025-11-25
| Capability | Details |
|---|---|
| tools | {
"listChanged": false
} |
Tools
Functions exposed to the LLM to take actions
| Name | Description |
|---|---|
| cu_capture_somC | Capture screen frame, extract UIA controls, and render Set-of-Marks overlay. |
| cu_clickB | Dispatch mouse click, double_click, right_click, move, or drag on [0..1000] grid. |
| cu_typeB | Synthesize Unicode keyboard text entry via Win32 KEYEVENTF_UNICODE. |
| cu_hotkeyB | Dispatch multi-key chord sequence (e.g. ctrl+shift+s) or single key tap. |
| cu_scrollC | Dispatch vertical mouse wheel scroll at [0..1000] normalized coordinates. |
| cu_verify_oracleC | Verify visual frame delta via 64-bit dHash and record RFC 6962 Merkle receipt. |
| cu_merkle_auditA | Retrieve RFC 6962 SHA-256 Merkle audit root, levels, and verified receipts. |
| cu_bg_captureB | Capture occluded or offscreen window surface via PrintWindow(PW_RENDERFULLCONTENT) with WM_PRINT fallback. |
| cu_bg_dispatchB | Dispatch focusless mouse/keyboard actions via PostMessageW or SendMessageTimeoutW(WM_SETTEXT). |
| cu_ghost_desktopC | Manage isolated Win32 kernel desktop session (WinSta0\AGY_GhostDesktop) for zero-focus-theft automation. |
| cu_find_anchorC | Locate template RGB icon on screen using pure Python SAD or NCC matching. |
| cu_replay_macroC | Replay recorded trajectory with self-healing UIA selector fallback. |
Prompts
Interactive templates invoked by user choice
| Name | Description |
|---|---|
No prompts | |
Resources
Contextual data attached and managed by the client
| Name | Description |
|---|---|
No resources | |
TDQS
Scored across 12 tools
Tools target mostly distinct capabilities: capture, foreground input, background dispatch, visual anchoring, macro replay, and audit/verification. The main overlap is between foreground action tools (cu_click, cu_type, cu_hotkey, cu_scroll) and cu_bg_dispatch, but the focusless PostMessage distinction is explicit; cu_merkle_audit and cu_verify_oracle are also closely related but separable.
All names use the consistent cu_ prefix and snake_case, with predictable action-oriented names. Minor noun-like labels such as cu_hotkey do not break the overall pattern.
Twelve tools is well-scoped for a Windows computer-use server. Each tool covers a distinct capability layer such as capture, input dispatch, verification, background execution, or replay.
Core computer-use operations are covered: screen capture, UIA/SOM extraction, clicking, typing, hotkeys, scrolling, background capture/dispatch, template matching, macro replay, and audit receipts. Gaps include no explicit window enumeration/focus management, clipboard operations, or macro recording, but most can be worked around.