mcp-server-macos-use
Controls macOS applications using accessibility APIs, enabling automated interaction with any app on the system.
This server does not currently have a deployable release on Glama. Follow the repository's setup instructions to install and configure it for your MCP client, including any required credentials and local dependencies.
mcp-server-macos-use
Official website: https://macos-use.dev/
Model Context Protocol (MCP) server in Swift. It allows controlling macOS applications by leveraging the accessibility APIs, primarily through the MacosUseSDK.
You can use it in Claude Desktop or other compatible MCP-client.
The server listens for MCP commands over standard input/output (stdio) and exposes several tools to interact with applications.
https://github.com/user-attachments/assets/cd203171-bac6-4124-9a58-59947a25be07
https://github.com/user-attachments/assets/f274560a-559f-4140-b133-c0b5c500a02d
Available Tools
The server exposes the following tools via the CallTool MCP method:
macos-use_open_application_and_traverseDescription: Opens or activates a specified application and then traverses its accessibility tree.
Parameters:
identifier(String, Required): The application's name, bundle ID, or file path.
macos-use_click_and_traverseDescription: Simulates a mouse click at specific coordinates within the window of the target application (identified by PID) and then traverses its accessibility tree.
Parameters:
pid(Number, Required): The Process ID (PID) of the target application.x(Number, Required): The X-coordinate for the click (relative to the window/screen, depending on SDK behavior).y(Number, Required): The Y-coordinate for the click.
macos-use_type_and_traverseDescription: Simulates typing text into the target application (identified by PID) and then traverses its accessibility tree.
Parameters:
pid(Number, Required): The Process ID (PID) of the target application.text(String, Required): The text to be typed.
macos-use_press_key_and_traverseDescription: Simulates pressing a specific keyboard key (e.g., 'Enter', 'Tab', 'a', 'B') with optional modifier keys held down, targeting the application specified by PID, and then traverses its accessibility tree.
Parameters:
pid(Number, Required): The Process ID (PID) of the target application.keyName(String, Required): The name of the key (e.g.,Return,Escape,ArrowUp,Delete,a,B). Case-sensitive for letters if no modifiers are active.modifierFlags(Array, Optional): An array of modifier keys to hold during the press. Valid values:CapsLock(orCaps),Shift,Control(orCtrl),Option(orOpt,Alt),Command(orCmd),Function(orFn),NumericPad(orNumpad),Help.
macos-use_refresh_traversalDescription: Only performs the accessibility tree traversal for the specified application (identified by PID). Useful for getting the current UI state without performing an action.
Parameters:
pid(Number, Required): The Process ID (PID) of the application to traverse.
Common Optional Parameters (for CallTool)
These can potentially be passed in the arguments object for any tool call to override default MacosUseSDK behavior (refer to ActionOptions in the code):
traverseBefore(Boolean, Optional): Traverse accessibility tree before the primary action.traverseAfter(Boolean, Optional): Traverse accessibility tree after the primary action (usually defaults to true).showDiff(Boolean, Optional): Include a diff between traversals (if applicable).onlyVisibleElements(Boolean, Optional): Limit traversal to visible elements.showAnimation(Boolean, Optional): Show visual feedback animation for actions.animationDuration(Number, Optional): Duration of the feedback animation.delayAfterAction(Number, Optional): Add a delay after performing the action.
Related MCP server: native-cua
Dependencies
MacosUseSDK(Assumed local or external Swift package providing macOS control functionality)
Building and Running
# Example build command (adjust as needed, use 'debug' for development)
swift build -c debug # Or 'release' for production
# Running the server (it communicates via stdin/stdout)
./.build/debug/mcp-server-macos-useIntegrating with Clients (Example: Claude Desktop)
Once built, you need to tell your client application where to find the server executable. For example, to configure Claude Desktop, you might add the following to its configuration:
{
"mcpServers": {
"mcp-server-macos-use": {
"command": "/path/to/your/project/mcp-server-macos-use/.build/debug/mcp-server-macos-use"
}
}
}Replace /path/to/your/project/ with the actual absolute path to your mcp-server-macos-use directory.
Help
Reach out to matt@mediar.ai Discord: m13v_
Plans
Happy to tailor the server for your needs, feel free to open an issue or reach out
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
This server cannot be deployed
Maintenance
Related MCP Connectors
MCP connector that lets ChatGPT list, search, and run your Apple Shortcuts via a local Mac agent
Connect ChatGPT and Claude to your Mac, Windows or Linux with secure MCP remote access.
- DNS-DATA RemoteDeprecatedcom.dns-data
Connect AI assistants to authorized Windows and macOS devices for files, commands, and management.
Automate 1,000+ services from any MCP-compatible AI agent: build Applets, run actions and queries.
Related MCP Servers
- AlicenseNot gradedqualityDmaintenanceEnables MCP clients to control macOS via accessibility and screen recording, providing tools to list apps, observe UI, click, type, press keys, and scroll.MIT
- FlicenseNot gradedqualityBmaintenanceEnables macOS computer-use automation through public Apple APIs, supporting app and window discovery, clicking, typing, scrolling, and field setting via accessibility controls.5-
- AlicenseNot gradedqualityCmaintenanceEnables MCP clients to inspect and operate native macOS apps through the Accessibility tree with safety-gated semantic actions, stale-state rejection, and outcome verification. Supports tools for app state reading, element finding, clicking, typing, form filling, window capture, and guarded workflows like menu selection and Save As.MIT
- AlicenseNot gradedqualityBmaintenanceEnables MCP hosts to observe and operate macOS apps by reading accessible controls, entering text, clicking, scrolling, capturing screenshots, and performing on-device OCR, with background app control and explicit human authorization.4MIT