hush
Provides computer-use tools for observing and controlling macOS applications in the background, including reading window outlines, batching clicks and typing, keyboard shortcuts, menu navigation, AppleScript/JXA scripting, screenshots, and window recording without stealing focus.
Hush
The fastest computer use for AI agents.
https://github.com/user-attachments/assets/d415d27b-6906-4f0c-a700-dbc79e826e34
Hush lets any agent see and drive the apps on your computer, in the background, while you keep working. Read a window, click, type, read it again: 178 ms. The next fastest tool takes 653 ms.
That's fast enough to win one-minute bullet against a 2200 chess.com bot, to play the third movement of the Moonlight Sonata at full tempo with every note on time, and to run ten agents on ten apps at once on one machine, all without anything coming to the front.
How it compares
Same window, same machine, one round of read, click, type, read (details):
Tool | Round | Works hidden | Works on another Space | Tool list (MCP) |
Hush | 178 ms | yes | yes | 598 tokenstools |
agent-desktop | 653 ms | yes | no | 10,514 tokens |
cua-driver | 1,134 ms | yes | mostly | 50,397 tokens |
Peekaboo | 3,506 ms | no | no | 13,847 tokens |
open-computer-use | 4,297 ms | yes | yes | 2,654 tokens |
On Cua Driver Bench v2's background tasks, agents on Hush went 15/15 with Claude Sonnet 5.5 and with Claude Haiku 5.5, the user never disturbed once. Sonnet took a median 17.8 s per task.
Related MCP server: macos-desktop-control
What an agent sees
An agent reads a window as a short outline, sends a batch of steps, and gets back only what changed:
observe TextEdit
# TextEdit · window "Notes.rtf" 800x600 · focus t1
e1 window "Notes.rtf"
e2 toolbar
b1 button "Bold"
p1 popup "Font" = "Helvetica"
t1 textarea = "Meeting notes, 13 Nov. Ship the…" (412 chars)
act TextEdit ["type t1 \" Done.\"", "key cmd+s"]
# 2/2 steps · 0.09 s · settled in 31 ms
~ t1 textarea: = "Meeting notes, 13 Nov. Ship the…" (412 chars) → = "Meeting notes, 13 Nov. Ship the…" (418 chars)
+ e3 sheet "Do you want to save changes?"
+ b2 button "Save"Never waits for nothing. Hush listens to the app's accessibility events and answers the moment they stop. It learns each app's pace, so a fast native app is never made to wait like a web view.
Tiny on tokens. Short refs that survive re-renders, then only the diffs. A repeat read of an unchanged window is 12 tokens.
Stays in the background. Events go to the target app only. Your front app keeps focus, your pointer stays put, your clipboard is untouched.
Any agent harness. Claude Code, Codex, OpenCode, Gemini CLI, your own loop: as a CLI, an MCP server or a skill.
Tools
Tool | What it does |
| Find running and installed apps |
| The outline of a window, then only what changed; |
| Run a batch of steps and return the change |
| Play key and pointer events on a millisecond schedule (music, games, drags) |
| Run AppleScript (in process, compiled once) or JXA |
| A screenshot of one window or element, for what the outline can't show |
| Film a window with an animated agent cursor |
Steps: click REF|X,Y, double REF, right REF, set REF VALUE, type [REF] TEXT,
key COMBO [xN], menu A > B, pick REF OPTION, select REF, focus REF,
scroll REF up|down|left|right [N], show REF, drag REF|X,Y to REF|X,Y,
wait gone REF | REF | text "T" | 500ms [within 10s], lane.
Timeline events, one per line: MS down KEY, MS up KEY, MS tap KEY [HOLD], MS down X,Y,
MS move X,Y, MS up X,Y, MS tap X,Y [HOLD]. Hush plays them on a real-time thread, under a
millisecond off schedule at the median.
Install
curl -fsSL https://raw.githubusercontent.com/OgnjenAdzic28/hush/main/install.sh | shThat's it. The installer puts hush in ~/.local/bin and runs hush setup, which asks macOS for
Accessibility and Screen Recording for your terminal and installs the Hush skill for
Claude Code and in ~/.agents/skills, the shared folder Codex, Cursor, Amp, Cline and most other
agents read (plus a rule that lets Codex run hush outside its sandbox). Then ask your agent to do
something in an app.
Needs macOS 15 or later. Run hush setup again any time to check permissions or update the skill.
Pick your agents: install the skill with the skills CLI instead, which lets you choose from 70+ agents:
npx skills add OgnjenAdzic28/hush --skill hushAnother harness: hush setup --skills-dir <its skills folder>, or use the MCP server:
claude mcp add hush -- hush mcp# ~/.codex/config.toml
[mcp_servers.hush]
command = "hush"
args = ["mcp"]From source: cargo install --git https://github.com/OgnjenAdzic28/hush hush, with Rust 1.100
or later (rustup update).
Try it yourself:
hush apps
hush observe Notes
hush act Notes 'click b2' 'type t1 "Groceries"' 'key enter'
hush see Notes --out notes.jpgMany agents at once
One Hush host serves every agent on your machine. It starts with the first command and goes away after ten idle minutes. Each agent gets its own session with its own refs and diffs. Agents on different apps run in parallel; two agents on the same app take turns, so their clicks and keys never interleave.
Ten sessions hammering one host: 500 calls in 2.2 s, zero errors, observe in 48 ms and see in
28 ms at the median, on one core and 101 MB.
The lane
Agents don't need your screen. The lane step moves an app's windows onto Hush's lane, a virtual
display nobody can see, parked off a corner of your main display where the pointer can't reach.
Windows there still render, take clicks and keys, and can be captured. When the host exits, apps in
the lane are hidden first, so nothing ever lands on your screen.
Recording demos
record films a window while Hush works in it, lane included, and draws an agent cursor into the
video: it glides to each click, leans into its motion, dips with a ripple on clicks and carries a
name tag. The cursor lives only in the video, and the pacing is real.
hush record Notes
hush act Notes 'click b2' 'type t1 "Groceries"'
hush record Notes --stop --label Claude --out demo.mp4Platforms
macOS today. The core, the engine and the MCP server are platform-neutral, so Windows and Linux are next.
Contributing
See CONTRIBUTING.md and AGENTS.md. Security reports: SECURITY.md.
License
MIT. See LICENSE and NOTICE.
Five tools. With
↩timeline, 755 tokens; with the menu catalog andrecord, about 920.
Available Tools
7 toolsactA
Run steps on an app's window in the background, without touching the user's focus, pointer or clipboard. Steps run in order, each waits until the app has finished reacting, and the batch stops at the first failure. Returns what changed. Put several steps in one call. Steps: click REF|X,Y · double REF · right REF · set REF VALUE · type [REF] TEXT · key COMBO [xN] · menu A > B · pick REF OPTION · select REF · focus REF · scroll REF up|down|left|right [N] · show REF · drag REF|X,Y to REF|X,Y (to a ref: takes its place) · wait gone REF|REF|text "T"|500ms [within 10s] · lane (move the app's windows off screen, where they still render and take clicks)
Inputs: app (required), steps (required), window.
appsA
List running apps, or find running and installed apps by name.
Inputs: query.
observeA
Outline of an app's window: one line per element, each with a ref like b3 or t1 for act. Later calls return only what changed. Long parts are folded; pass focus to open one. In apps that draw their own interface, labels read from the pixels appear as seen (v refs): click or drag them.
Inputs: app (required), full, focus, menus, +1 more.
recordA
Record a window to MP4 for a demo: start, act, then call with stop. The video shows an animated cursor at each action, in real time.
Inputs: app (required), out, stop, label, +1 more.
scriptC
Run AppleScript (default) or JavaScript for Automation. Best for apps with a scripting dictionary. Returns the result as text.
Inputs: app (required), source (required), language.
seeA
Screenshot of a window, or of one element by ref. Only for what the outline can't show: canvases, video, images, charts.
Inputs: app (required), ref, width, window.
timelineA
Play key and pointer events on a millisecond schedule in an app's window, in the background. For input whose timing matters: music, games, drags, holds. Plan the whole sequence, then send it once. One event per line, MS VERB ARGS (MS = time from the start): MS down KEY · MS up KEY · MS tap KEY [HOLD_MS] · MS down X,Y [right] · MS up X,Y [right] · MS move X,Y · MS tap X,Y [HOLD_MS] [right]. KEY like a, shift+a, space, left. X,Y are window points. HOLD_MS defaults to 40.
Inputs: app (required), events (required), window.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 7 tools
The tools mostly target distinct phases of GUI automation: listing apps, observing structure, acting, timed input, scripting, screenshots, and recording. observe vs see and act vs timeline overlap somewhat, but the descriptions draw clear boundaries. An agent should usually select the right tool without serious confusion.
All names are short lowercase single words, which is stylistically consistent. However, the set mixes verbs (observe, act, see, record) with nouns (apps, timeline, script), so there is no predictable action-oriented naming pattern. It remains readable, but boundaries rely on descriptions rather than names.
Seven tools is well-scoped for a macOS GUI automation server. Each tool has a clear role, and none feels redundant or extraneous. The surface is neither thin nor bloated.
The set covers the core automation loop: find apps, observe UI structure, act, send timed input, script, take screenshots, and record demonstrations. Minor gaps exist, such as no explicit app launch/quit/window-management tool, but scripting can likely fill those gaps. Overall the surface is robust with only small workaround-level omissions.
Maintenance
Related MCP Connectors
iMessage for AI agents, from your iPhone. No Mac needed, and you choose which chats they read.
Mac & Windows: let ChatGPT, Claude & Cursor use your email, calendar, iMessage, Teams, files.
Build and run agents and automations across hundreds of apps using natural language.
Reach your own computers from any AI app: files, commands, screen and mouse, approvals and alerts.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables AI assistants to automate macOS desktop tasks including mouse control, keyboard input, screenshots, window management, and UI interaction.417MIT
- AlicenseNot gradedqualityDmaintenanceProvides native macOS desktop automation for AI agents, enabling screen capture, mouse/keyboard control, window management, and iOS/Android simulator control in both foreground and background modes without focus stealing.6MIT
- AlicenseNot gradedqualityBmaintenanceLets AI agents see and control desktop applications through the accessibility layer, enabling clicking, typing, scrolling, dragging, and window/app management across macOS, Windows, and Linux entirely on the local machine.27MIT
- FlicenseNot gradedqualityBmaintenanceLets AI agents drive your real, already-logged-in browsers on macOS in the background without stealing focus, organizing work into tab groups, reading pages as compact accessibility snapshots, and saving repeatable scenarios. Supports Chrome, Edge, Brave, Yandex Browser, and Safari, with per-agent isolation and automatic tab cleanup.-