sleight
Drives native macOS apps in the background: Claude writes JavaScript against the bundled computer-use engine to launch apps, click, drag, type, read each app's accessibility tree and capture screenshots, while the target app stays behind the user's other windows and the cursor stays usable. Adds tools for menu bar icons and notifications (System Events UI scripting) and for real-mouse drags that the engine's app-level drag can't perform.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@sleightopen Calculator in the background and compute 12 × 12"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
sleight is an MIT-licensed plugin for Claude Code, Codex, Grok CLI and Cursor (install not yet run). Grok Bot uses its local shell. Ask it to work out a sum in Calculator or edit a document, and it operates that app in the background.
You need an Apple Silicon Mac. The ChatGPT desktop app is required in /Applications because sleight runs its computer-use engine.
You don't need a ChatGPT account or sign-in. sleight uses your coding agent's account or API access, without a separate Codex sign-in.
sleight is unofficial. OpenAI and Anthropic don't endorse or support it. A ChatGPT update can break it. The new install flow and setup in a fresh macOS user haven't run live. Install time and typical task cost are unmeasured. Seerequirements for tested macOS versions. sleight contains no OpenAI code.
LCU, Cua, Peekaboo and FowlBrowser are competing computer-use tools. An arm means one agent setup.
sleight's own 9-task native Mac benchmark: 251.2 s total expected time. Claude computer use: 453.9 s. Expected time is mean time per attempt divided by the pass rate, estimating time to a correct result when failed attempts are retried. Benchmark hub · Interactive page
Install
Install sleight from https://github.com/Land-o-Clusters/sleight and check it with its doctor.Paste that into your coding agent. It follows INSTALL.md, stopping for your admin password, macOS permissions, Chrome's debugging switch and app approvals.
Related MCP server: Windows Computer Control MCP Server
Where it runs
Host | Install route and validation | Limits |
Claude Code 2.1.288 or later | Plugin. Native and app claims on 2.1.289. | No known host-specific gaps. |
Codex CLI | Plugin. Calculator and TextEdit passed on 0.160.0 after first-call retries, fixed since but not rerun live. | Turbo needs trusted hooks and awaits a live check. |
Grok CLI | Direct MCP. Handshake on 1.0.13. Model and app tasks untested. | Turbo off. Results capped at 20,000 bytes. |
Grok Bot (preview) | Local shell via | Turbo off. Approvals wait in the menu bar glove (limits). |
Other MCP clients | Stdio config, tested with our own client. | Turbo unavailable. |
Cursor | Plugin, with marketplace install unverified. | Turbo unavailable. |
The action pane, status line and /sleight are Claude Code only (host details).
To install by hand, follow INSTALL.md. If Computer Use is already on in ChatGPT or Codex, installing the plugin is enough. Otherwise run ./bin/sleight-mcp setup from the installed plugin folder (Computer Use). It uses ChatGPT's Node runtime. npm isn't needed.
sleight drives native apps, including Electron apps such as VS Code, Slack and Spotify, through the engine. Safari and Firefox use the engine's accessibility path. The engine refuses terminals and OpenAI's own apps (how it works).
Turbo
Turbo drives Chrome and Helium directly. It is on by default after you enable Chrome's one-time debugging switch. The browser asks you to allow each connection (setup).
Turbo results: on Haiku 5.5, lowest expected times in Chrome 12/13 (sleight 256.1 s, FowlBrowser 399.2 s) and Helium 12/13 (sleight 258.2 s, FowlBrowser 434.0 s). On Opus 5.5, lowest expected times in Chrome 12/13 (sleight 232.6 s, FowlBrowser without a total) and Helium 12/13 (sleight 219.8 s, FowlBrowser without a total). FowlBrowser paid on the unpriced checkout in 1 of 3 Chrome and 2 of 3 Helium Haiku runs, and its expected time includes those failures. In the Haiku held-out set, sleight completed 6 of 8 tasks, with the lowest expected time on 3 of 8. FowlBrowser completed 7 of 8 tasks, with the lowest expected time on 5 of 8. Neither arm has a complete-suite total. Engine 26.1023.50603, 2026-10-28.
Chrome, turbo against FowlBrowser, 2026-10-28, 15:19 to 17:43 UTC. Expected seconds per task for sleight turbo and FowlBrowser. sleight turbo has the lowest expected time on 12 of 13 tasks. FowlBrowser paid on the unpriced checkout in 1 of 3 Chrome and 2 of 3 Helium Haiku runs, and its expected time includes those failures.
From the installed plugin folder, you run ./bin/sleight-mcp turbo on (Chrome first, then Helium), ./bin/sleight-mcp turbo on --browser helium to choose Helium, or ./bin/sleight-mcp turbo off to opt out until you turn it on again (settings).
New in 1.5.0
Turbo reads include screenshots, motion frames, whole threads, PDFs and structured tables. Paste and download steps work on observed controls and links.
Sign-in handoffs keep the page for the person and resume after Continue. Away calls return a pending result promptly.
The optional agent cursor has a branded ring, character styles and click-to-pause controls. Its open protocol supports other renderers, and imports explain missing animations and fallbacks.
Optional narration uses Claude's existing prose and local system voices. Private run recordings support local replay. Screenshots can contain sensitive content.
Native source inspection refuses ambiguous syntax. Deferred engine documentation retains its provenance so caller output cannot become trusted instructions.
Release A/B: RELEASE PASS: final release A/B against 1.4.2 (the 1.5.0 harness with the 1.4.2 plugin tree), 8 of 8 groups within their time and pass-loss limits (2026-10-28, 06:10 to 14:04 UTC, engine 26.1023.50603 build 22391). 3 scored banks, including the older engine records.
Native claim, 2026-10-17 to 2026-10-18: sleight's total expected time over 9 tasks is 251.2 s against Claude computer use at 453.9 s, and LCU, Codex, Cua and Peekaboo have no total because each never passed at least one task.
How fast
Native claim: "fastest", sleight's total expected time 251.2 s over 9 tasks (197 runs, 2026-10-17 to 2026-10-18). Engine 26.1007.71326, 2026-10-17 to 2026-10-18.
App claim: "fastest", sleight's total expected time 56.8 s over 3 tasks (60 runs, 2026-10-18, 02:39 to 03:16 UTC). Engine 26.1007.71326, 2026-10-18.
Chrome and Helium: turbo against FowlBrowser: on Haiku 5.5, lowest expected times in Chrome 12/13 (sleight 256.1 s, FowlBrowser 399.2 s) and Helium 12/13 (sleight 258.2 s, FowlBrowser 434.0 s). On Opus 5.5, lowest expected times in Chrome 12/13 (sleight 232.6 s, FowlBrowser without a total) and Helium 12/13 (sleight 219.8 s, FowlBrowser without a total). FowlBrowser paid on the unpriced checkout in 1 of 3 Chrome and 2 of 3 Helium Haiku runs, and its expected time includes those failures. In the Haiku held-out set, sleight completed 6 of 8 tasks, with the lowest expected time on 3 of 8. FowlBrowser completed 7 of 8 tasks, with the lowest expected time on 5 of 8. Neither arm has a complete-suite total. Engine 26.1023.50603, 2026-10-28.
Safari and Firefox: the engine path against Codex, LCU, Cua and Peekaboo: in Safari sleight has completed every task and is fastest on 12 of 12 tasks. It is the only arm with a total (682.3 s) (
sleight-fs2on, 2026-10-18). In Firefox sleight has completed every task and is fastest on 12 of 12 tasks. Its total is 455.0 s (sleight-fs2on, 2026-10-18). Engine 26.1007.71326, 2026-10-18 and engine 26.1013.40934, 2026-10-19.Experiments: 17 studies with run data. The catalog has 96 benchmark write-ups and includes studies without structured run data.
Validation: build A against build B: RELEASE PASS: final release A/B against 1.4.2 (the 1.5.0 harness with the 1.4.2 plugin tree), 8 of 8 groups within their time and pass-loss limits (2026-10-28, 06:10 to 14:04 UTC, engine 26.1023.50603 build 22391). 3 scored banks, including the older engine records.
Release passes and the earlier head-to-heads: 7 release passes (2026-10-05 to 2026-10-09), 115 results files in all.
Total expected seconds of sleight against the next-best arm with a total, in the newest complete set of each benchmark. Native apps, 251.2 s against Claude computer use at 453.9 s. VS Code, Slack, Spotify, 56.8 s against LCU at 101.3 s. Chrome, turbo, 256.1 s against FowlBrowser at 399.2 s. Helium, turbo, 258.2 s against FowlBrowser at 434.0 s. Safari, engine path, 682.3 s, and no other arm has a total. Firefox, engine path, 455.0 s against Cua at 2541.4 s. FowlBrowser paid on the unpriced checkout in 1 of 3 Chrome and 2 of 3 Helium Haiku runs, and its expected time includes those failures.
How it works
The engine is the computer-use software bundled with ChatGPT. sleight's launcher starts it on ChatGPT's own Node runtime. The relay connects it to your agent and shows approval cards. In Claude Code, a UI extension (the mod) draws the action pane and ends the engine's turn after each of yours (how it works).
Safety
These are the intended checks. Known problems lists guards with only unit coverage and what has run live.
Each app gets one approval card with Allow, Always allow and Decline.
Always allow, payment and consent buttons accept only a person's click or key press.
VoiceOver, Switch Control, Voice Control and screen-sharing users need a physical keyboard or pointer for these cards in 1.4.0 (limits and planned alternative).
A payment goes ahead without another prompt only when your own message names what to pay, the amount and what to pay with. When a page tries to pay, sleight always asks (settings).
sleight treats page text as untrusted input when checking actions and approvals. The
jstool runs JavaScript as you, so Claude Code asks before each call unless you allowmcp__plugin_sleight_computer__js.sleight never switches Spaces or takes focus, except for Chrome's own consent prompt. A few fallbacks (foreground drag,
hover, some menu bar icons) move the pointer briefly, each after you've stopped typing for 2 s.
More
INSTALL.md for every host, setup, update and uninstall. Settings lists every switch with its default, and privacy what sleight writes on your Mac (it doesn't call the network itself).
Known problems with the runs that showed each one, the benchmark method, the changelog and the roadmap.
Credits
@argofowl showed that the ChatGPT app's computer-use server works outside Codex.
LCU, started by 0xpolarzero, takes the same idea across several harnesses, and its notes mapped out the runtime's lifecycle.
Turbo includes playwright-core 1.64.0, unmodified, with its notices in THIRD-PARTY-NOTICES.md.
License
MIT. The ChatGPT app and its computer-use runtime belong to OpenAI, under OpenAI's terms, and sleight doesn't include or redistribute either. ChatGPT, Codex, Claude, Cursor, Chrome, Safari, Firefox, Helium, Microsoft Word, Excel, VS Code, Slack, Spotify and other app names are trademarks of their owners, who don't endorse or sponsor sleight, and appear here to describe compatibility and benchmark results.
This server cannot be deployed
Maintenance
Related MCP Connectors
Use your Mac, Windows or Linux computer from ChatGPT, Claude or Codex: files, commands, documents.
Mac & Windows: let ChatGPT, Claude & Cursor use your email, calendar, iMessage, Teams, files.
Connect AI assistants to your approved computer for files, commands, browser and desktop tasks.
Build agents to automate any background task. Works with your ChatGPT/Claude subscription.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables high-speed native macOS automation for Claude by interacting directly with the Accessibility API, AppleScript, and UI trees instead of using screenshots. It allows users to read app states, click elements, and type text semantically across any macOS application.12 npm12MIT
- AlicenseNot gradedqualityDmaintenanceEnables Claude Desktop to control mouse, keyboard, and clipboard on Windows, allowing AI-driven computer interaction tasks like clicking, typing, scrolling, and screenshotting.MIT
- AlicenseNot gradedqualityBmaintenanceEnables controlling macOS apps in the background, letting Claude Code or Codex act on native app UI elements without foregrounding them.1MIT
- AlicenseAqualityAmaintenanceEnables Claude Code to read and operate macOS app interfaces through the accessibility tree, pressing buttons, setting text fields, typing with IME support, sending shortcuts, scrolling, dragging, and capturing screenshots. It drives background apps without moving the mouse or stealing focus from the user's current work.1228 npmMIT