MCP Remote macOS Control Server
Enables full remote control of macOS systems via VNC, including screen capture, keyboard input, mouse operations (move, click, double-click, scroll, drag-and-drop), and application launching.
Uses OpenAI's GPT-4 for natural language understanding to translate user commands into macOS control actions through the web chat interface.
Provides low-latency real-time screen sharing through LiveKit integration as an alternative to traditional VNC connections.
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@MCP Remote macOS Control Servertake a screenshot of my desktop"
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
MCP Remote macOS Control Server + AI Chat Web App
The first open-source MCP server that enables AI to fully control remote macOS systems, now with a web-based chat interface.
This project provides both:
MCP Server - Python-based server for remote macOS control via VNC
AI Chat Web App - Modern web interface for chatting with AI to control your Mac
š Quick Start for Web App
Prerequisites
Docker Desktop installed
Node.js 18+ installed
A Mac with Screen Sharing enabled (can be the same machine)
1. Clone and Setup
git clone <repository-url>
cd mcp_macos
# Install root dependencies
npm install
# Install frontend and backend dependencies
npm run install:all2. Configure Environment
# Copy example environment file
cp backend/.env.example backend/.env
# Edit backend/.env with your settings:
# - MACOS_HOST=localhost (for local control)
# - MACOS_PASSWORD=your_vnc_password
# - OPENAI_API_KEY=your_openai_api_key3. Enable Screen Sharing (macOS)
Open System Preferences > Sharing
Enable "Screen Sharing"
Set a VNC password when prompted
4. Run the Application
# Start both frontend and backend
npm run dev
# Or start individually:
npm run dev:frontend # Frontend on http://localhost:3000
npm run dev:backend # Backend on http://localhost:30015. Open and Chat!
Open http://localhost:3000 in your browser
Wait for connection to establish
Try commands like:
"Take a screenshot"
"Open Safari"
"Click on the Dock"
"Type hello world"
Related MCP server: VNC MCP Server
š Project Structure
mcp_macos/
āāā frontend/ # Next.js React frontend
ā āāā src/
ā ā āāā components/ # Chat interface components
ā ā āāā hooks/ # Socket.IO and state management
ā ā āāā stores/ # Zustand state stores
ā ā āāā types/ # TypeScript definitions
āāā backend/ # Node.js Express backend
ā āāā src/
ā ā āāā services/ # MCP client, LLM service, chat service
ā ā āāā config/ # Environment configuration
ā ā āāā utils/ # Logging and utilities
āāā src/ # Original Python MCP server
āāā mcp_remote_macos_use/
āāā action_handlers.py
āāā vnc_client.pyš§ Development Commands
# Development
npm run dev # Start both frontend and backend
npm run dev:frontend # Start only frontend
npm run dev:backend # Start only backend
# Building
npm run build # Build both
npm run build:frontend # Build frontend only
npm run build:backend # Build backend only
# Testing
npm run test # Run all testsšÆ Architecture
Browser āā Frontend (Next.js) āā Backend (Node.js) āā MCP Server (Python) āā macOS
WebSocket/HTTP Socket.IO/REST Docker/stdio VNCš ļø How It Works
Frontend: Modern React app with real-time chat interface
Backend: Express.js server with Socket.IO for real-time communication
LLM Integration: OpenAI GPT-4 for natural language understanding
MCP Client: Communicates with Python MCP server via Docker
macOS Control: VNC-based control of local or remote Macs
š® Example Interactions
You: "Take a screenshot"
AI: "Here's a screenshot of your Mac desktop:" [shows image]
You: "Click on Safari in the dock"
AI: "I'll click on Safari in the dock for you" [clicks Safari]
You: "Open a new tab and go to apple.com"
AI: "Opening a new tab and navigating to apple.com" [executes commands]š Security Notes
Only use with Macs you own or have explicit permission to control
VNC passwords are transmitted securely
LLM API keys are stored server-side only
All actions are logged for debugging
š Original MCP Server Documentation
The original Python MCP server functionality remains fully intact. See below for the original documentation about using it directly with Claude Desktop.
Original MCP Server Documentation
The first open-source MCP server that enables AI to fully control remote macOS systems.
A direct alternative to OpenAI Operator, optimized specifically for autonomous AI agents with complete desktop capabilities, requiring no additional software installation.
Showcases
Research Twitter and Post Twitter(https://www.youtube.com/watch?v=--QHz2jcvcs)
Use CapCut to create short highlight video(https://www.youtube.com/watch?v=RKAqiNoU8ec)
AI Recruiter: Automated candidate information collection, qualifying applications and sending screening sessions using Mail App
AI Marketing Intern: LinkedIn engagement - automated following, liking, and commenting with relevant users
AI Marketing Intern: Twitter engagement - automated following, liking, and commenting with relevant users
To-Do List (Prioritized)
Performance Optimization - Match speed of Ubuntu desktop alternatives
Apple Scripts Generation - Reduce execution time while maintaining flexibility
VNC Cursor Visibility - Improve debugging and demo experience
We welcome contributions!
Features
No Extra API Costs: Free screen processing with your existing Claude Pro plan
Minimal Setup: Just enable Screen Sharing on the target Mac ā no additional software needed
Universal Compatibility: Works with all macOS versions, current and future
Why We Built This
Native macOS Experience Without Compromise
The macOS native ecosystem remains unmatched in user experience today and will continue to be the gold standard for years to come. This is where human capabilities truly thrive, and now your AI can operate in this environment with the same fluency.
Open Architecture By Design
Universal LLM Compatibility: Work with any MCP Client of your choice
Model Flexibility: Seamlessly integrate with OpenAI, Anthropic, or any other LLM provider
Future-Proof Integration: Designed to evolve with the MCP ecosystem
Effortless Deployment
Zero Setup on Target Machines: No background applications or agents needed on macOS
Screen Sharing is All You Need: Control any Mac with Screen Sharing enabled
Eliminate Backend Complexity: Unlike other solutions that require running Python applications or background services
Streamlined Bootstrap Process
Leverage Claude Desktop's Polished UI: No need for developer-style Python interfaces
Intuitive User Experience: Interact with your AI-controlled Mac through a familiar, user-friendly interface
Instant Productivity: Start working immediately without configuration hassles
Architecture
Installation
Enable Screen Sharing on MacOs If you rent a mac from macstadium.com, you can skip this step
Add this MCP server to Claude Desktop You can configure Claude Desktop to use the Docker image by adding the following to your Claude configuration:
{
"mcpServers": {
"remote-macos-use": {
"command": "docker",
"args": [
"run",
"-i",
"-e",
"MACOS_USERNAME=your_macos_username",
"-e",
"MACOS_PASSWORD=your_macos_password",
"-e",
"MACOS_HOST=your_macos_hostname_or_ip",
"--rm",
"buryhuang/mcp-remote-macos-use:latest"
]
}
}
}WebRTC Support via LiveKit
This server now includes WebRTC support through LiveKit integration, enabling:
Low-latency real-time screen sharing
Improved performance and responsiveness
Better network efficiency compared to traditional VNC
Automatic quality adaptation based on network conditions
To use WebRTC features, you'll need to:
Set up a LiveKit server or use LiveKit Cloud
Configure the LiveKit environment variables as shown in the configuration example above
Developer Instruction
Clone the repo
# Clone the repository
git clone https://github.com/yourusername/mcp-remote-macos-use.git
cd mcp-remote-macos-useBuilding the Docker Image
# Build the Docker image
docker build -t mcp-remote-macos-use .Cross-Platform Publishing
To publish the Docker image for multiple platforms, you can use the docker buildx command. Follow these steps:
Create a new builder instance (if you haven't already):
docker buildx create --useBuild and push the image for multiple platforms:
docker buildx build --platform linux/amd64,linux/arm64 -t buryhuang/mcp-remote-macos-use:latest --push .Verify the image is available for the specified platforms:
docker buildx imagetools inspect buryhuang/mcp-remote-macos-use:latest
Usage
The server provides Remote MacOs functionality through MCP tools.
Tools Specifications
The server provides the following tools for remote macOS control:
remote_macos_get_screen
Connect to a remote macOS machine and get a screenshot of the remote desktop. Uses environment variables for connection details.
remote_macos_send_keys
Send keyboard input to a remote macOS machine. Uses environment variables for connection details.
remote_macos_mouse_move
Move the mouse cursor to specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
remote_macos_mouse_click
Perform a mouse click at specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
remote_macos_mouse_double_click
Perform a mouse double-click at specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
remote_macos_mouse_scroll
Perform a mouse scroll at specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
remote_macos_open_application
Opens/activates an application and returns its PID for further interactions.
remote_macos_mouse_drag_n_drop
Perform a mouse drag operation from start point and drop to end point on a remote macOS machine, with automatic coordinate scaling.
All tools use the environment variables configured during setup instead of requiring connection parameters.
Limitations
Authentication Support:
Only Apple Authentication (protocol 30) is supported
Security Note
https://support.apple.com/guide/remote-desktop/encrypt-network-data-apdfe8e386b/mac https://cafbit.com/post/apple_remote_desktop_quirks/
We only support protocol 30, which uses the Diffie-Hellman key agreement protocol with a 512-bit prime. This protocol is used by macOS 11 to macOS 12 when communicating with OS X 10.11 or earlier clients.
Here's the information converted to a markdown table:
macOS version running Remote Desktop | macOS client version | Authentication | Control and Observe | Copy items or install package | All other tasks | Protocol Version |
macOS 13 | macOS 13 | 2048-bit RSA host keys | 2048-bit RSA host keys | 2048-bit RSA host keys to authenticate, then 128-bit AES | 2048-bit RSA host keys | 36 |
macOS 13 | macOS 10.12 | Secure Remote Password (SRP) protocol for local only. Diffie-Hellman (DH) if bound to LDAP or macOS server is version 10.11 or earlier | SRP or DH,128-bit AES | SRP or DH to authenticate, then 128-bit AES | 2048-bit RSA host keys | 35 |
macOS 11 to macOS 12 | macOS 10.12 to macOS 13 | Secure Remote Password (SRP) protocol for local only, Diffie-Hellman if bound to LDAP | SRP or DH 1024-bit, 128-bit AES | 2048-bit RSA host keys macOS 13 to macOS 10.13 | 2048-bit RSA host keys macOS 10.13 or later | 33 |
macOS 11 to macOS 12 | OS X 10.11 or earlier | DH 1024-bit | DH 1024-bit, 128-bit AES | Diffie-Hellman Key agreement protocol with a 512-bit prime | Diffie-Hellman Key agreement protocol with a 512-bit prime | 30 |
Always use secure, authenticated connections when accessing remote remote MacOs machines. This tool should only be used with servers you trust and have permission to access.
License
See the LICENSE file for details.
Available Tools
8 toolsremote_macos_get_screenB
Connect to a remote MacOs machine and get a screenshot of the remote desktop. Uses environment variables for connection details.
| Name | Required | Description | Default |
|---|---|---|---|
No parameters | |||
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries the full burden. It discloses that the tool connects remotely and uses environment variables, but doesn't mention behavioral traits like authentication needs, potential latency, error handling, or what the output looks like (e.g., image format). For a remote operation tool with zero annotation coverage, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is concise and front-loaded, consisting of two sentences that directly state the purpose and connection method. There's no wasted text, and it efficiently communicates key information, though it could be slightly more structured (e.g., separating prerequisites).
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's complexity (remote operation) and lack of annotations and output schema, the description is moderately complete. It covers the basic action and connection method but misses details like output format, error cases, or dependencies. For a tool with no structured support, it's adequate but has clear gaps.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 0 parameters with 100% coverage, so no parameters need documentation. The description adds context about environment variables for connection details, which compensates for the lack of parameters. This provides useful semantic information beyond the schema, earning a high score.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the tool's purpose: 'Connect to a remote MacOs machine and get a screenshot of the remote desktop.' It specifies the verb ('get a screenshot') and resource ('remote desktop'), but doesn't explicitly distinguish it from sibling tools (e.g., mouse actions, application opening). This makes it clear but not fully differentiated.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides minimal usage guidance: it mentions using environment variables for connection details, which implies prerequisites. However, it doesn't specify when to use this tool versus alternatives (e.g., other remote tools for different actions) or any exclusions. This lack of explicit context guidance limits its helpfulness.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
remote_macos_mouse_clickC
Perform a mouse click at specified coordinates on a remote MacOs machine, with automatic coordinate scaling. Uses environment variables for connection details.
| Name | Required | Description | Default |
|---|---|---|---|
| x | Yes | X coordinate for mouse position (in source dimensions) | |
| y | Yes | Y coordinate for mouse position (in source dimensions) | |
| source_width | No | Width of the reference screen for coordinate scaling | |
| source_height | No | Height of the reference screen for coordinate scaling | |
| button | No | Mouse button (1=left, 2=middle, 3=right) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden. It mentions 'automatic coordinate scaling' and 'environment variables for connection details', which adds some behavioral context, but fails to disclose critical aspects like required permissions, network dependencies, error handling, or what happens if the remote machine is unavailable. For a remote control tool with zero annotation coverage, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence that front-loads the core action and includes key behavioral details (coordinate scaling, environment variables) without unnecessary elaboration. Every word earns its place.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a remote control tool with no annotations and no output schema, the description is incomplete. It lacks information on error conditions, return values, security implications, or performance characteristics, leaving significant gaps for an AI agent to understand tool behavior fully.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, providing full parameter documentation. The description adds minimal value beyond the schema by mentioning 'automatic coordinate scaling', which relates to source_width and source_height parameters, but doesn't explain scaling mechanics or environmental variable usage. Baseline 3 is appropriate as the schema does the heavy lifting.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('perform a mouse click') and target ('on a remote MacOS machine'), distinguishing it from siblings like mouse_move or mouse_drag_n_drop by specifying click behavior. However, it doesn't explicitly differentiate from mouse_double_click, which is a similar click action.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description mentions 'automatic coordinate scaling' and 'environment variables for connection details', which provides some context, but offers no explicit guidance on when to use this tool versus alternatives like mouse_double_click or mouse_drag_n_drop, nor any prerequisites or exclusions.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
remote_macos_mouse_double_clickB
Perform a mouse double-click at specified coordinates on a remote MacOs machine, with automatic coordinate scaling. Uses environment variables for connection details.
| Name | Required | Description | Default |
|---|---|---|---|
| x | Yes | X coordinate for mouse position (in source dimensions) | |
| y | Yes | Y coordinate for mouse position (in source dimensions) | |
| source_width | No | Width of the reference screen for coordinate scaling | |
| source_height | No | Height of the reference screen for coordinate scaling | |
| button | No | Mouse button (1=left, 2=middle, 3=right) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden. It mentions 'automatic coordinate scaling' and 'Uses environment variables for connection details', which are useful behavioral disclosures. However, it doesn't cover important aspects like authentication requirements, error conditions, network dependencies, or what happens if the remote machine is unavailable - significant gaps for a remote control tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is efficiently structured in two sentences that each add value: first stating the core action with key features, second explaining implementation details. No redundant information, though it could be slightly more front-loaded with the most critical information.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a remote control tool with 5 parameters, no annotations, and no output schema, the description provides basic context but lacks completeness. It covers the what and how of coordinate scaling but misses important operational context like error handling, performance characteristics, or what the tool returns upon execution.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, providing complete parameter documentation. The description adds value by explaining the overall purpose of coordinate scaling and environment variable usage, but doesn't provide additional semantic context beyond what's already in the schema descriptions. This meets the baseline for high schema coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the specific action ('Perform a mouse double-click'), target resource ('on a remote MacOs machine'), and key behavior ('with automatic coordinate scaling'). It distinguishes from sibling tools like 'remote_macos_mouse_click' by specifying the double-click action.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage context through 'remote MacOs machine' and 'automatic coordinate scaling', but doesn't explicitly state when to use this tool versus alternatives like 'remote_macos_mouse_click' or 'remote_macos_mouse_drag_n_drop'. No explicit when-not-to-use guidance or prerequisites are provided.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
remote_macos_mouse_drag_n_dropB
Perform a mouse drag operation from start point and drop to end point on a remote MacOs machine, with automatic coordinate scaling.
| Name | Required | Description | Default |
|---|---|---|---|
| start_x | Yes | Starting X coordinate (in source dimensions) | |
| start_y | Yes | Starting Y coordinate (in source dimensions) | |
| end_x | Yes | Ending X coordinate (in source dimensions) | |
| end_y | Yes | Ending Y coordinate (in source dimensions) | |
| source_width | No | Width of the reference screen for coordinate scaling | |
| source_height | No | Height of the reference screen for coordinate scaling | |
| button | No | Mouse button (1=left, 2=middle, 3=right) | |
| steps | No | Number of intermediate points for smooth dragging | |
| delay_ms | No | Delay between steps in milliseconds |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden but lacks critical behavioral details. It doesn't disclose whether this requires specific permissions, what happens if coordinates are out of bounds, whether it's synchronous/asynchronous, or error conditions. The mention of 'automatic coordinate scaling' is helpful but insufficient for a mutation tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Single sentence efficiently conveys core functionality without redundancy. Every word earns its place by specifying the operation, target environment, and key technical feature.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a 9-parameter mutation tool with no annotations and no output schema, the description is inadequate. It doesn't explain what happens after the drag operation, what success/failure looks like, or important behavioral constraints. The agent lacks sufficient context to use this tool safely and effectively.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so parameters are well-documented in the schema. The description adds minimal value beyond the schema by mentioning 'automatic coordinate scaling' which relates to source_width/source_height parameters, but doesn't provide additional context about how scaling works or parameter interactions.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the specific action ('Perform a mouse drag operation'), target resource ('on a remote MacOs machine'), and key capability ('with automatic coordinate scaling'). It distinguishes from siblings like mouse_click and mouse_move by specifying drag-and-drop functionality.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No guidance is provided about when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing remote connection established), nor does it differentiate from similar tools like mouse_move or when drag-and-drop is appropriate versus separate click operations.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
remote_macos_mouse_moveC
Move the mouse cursor to specified coordinates on a remote MacOs machine, with automatic coordinate scaling. Uses environment variables for connection details.
| Name | Required | Description | Default |
|---|---|---|---|
| x | Yes | X coordinate for mouse position (in source dimensions) | |
| y | Yes | Y coordinate for mouse position (in source dimensions) | |
| source_width | No | Width of the reference screen for coordinate scaling | |
| source_height | No | Height of the reference screen for coordinate scaling |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
No annotations are provided, so the description carries full burden. It mentions 'automatic coordinate scaling' and 'environment variables for connection details', which add some behavioral context, but lacks details on permissions, error handling, or what happens if the remote machine is unavailable. For a remote control tool with zero annotation coverage, this is insufficient.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
Two concise sentences front-load the core functionality and key details (coordinate scaling, environment variables). No wasted words, though it could be slightly more structured for clarity.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
For a remote control tool with 4 parameters, no annotations, and no output schema, the description is incomplete. It doesn't explain return values, error conditions, or important behavioral aspects like how coordinates are mapped or what 'automatic scaling' entails in practice.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema fully documents all parameters. The description adds context about 'automatic coordinate scaling', which relates to the source_width and source_height parameters, but doesn't provide additional syntax or format details beyond what the schema specifies. Baseline 3 is appropriate when schema does the heavy lifting.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Move the mouse cursor') and target ('on a remote MacOs machine'), with additional context about coordinate scaling. It distinguishes from siblings like 'mouse_click' or 'mouse_drag_n_drop' by focusing on cursor positioning, but doesn't explicitly contrast with them.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
No explicit guidance on when to use this tool versus alternatives like 'mouse_drag_n_drop' for dragging or 'mouse_click' for clicking after moving. It mentions environment variables for connection, but doesn't specify prerequisites or exclusions for usage.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
remote_macos_mouse_scrollA
Perform a mouse scroll at specified coordinates on a remote MacOs machine, with automatic coordinate scaling. Uses environment variables for connection details.
| Name | Required | Description | Default |
|---|---|---|---|
| x | Yes | X coordinate for mouse position (in source dimensions) | |
| y | Yes | Y coordinate for mouse position (in source dimensions) | |
| source_width | No | Width of the reference screen for coordinate scaling | |
| source_height | No | Height of the reference screen for coordinate scaling | |
| direction | No | Scroll direction | down |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden for behavioral disclosure. It mentions 'automatic coordinate scaling' and 'environment variables for connection details', which adds some context about how the tool works. However, it doesn't disclose critical behavioral traits like whether this requires specific permissions, potential side effects, error conditions, or what happens if the remote machine is unavailableāsignificant gaps for a remote control tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, well-structured sentence that efficiently conveys the core functionality. Every element earns its place: the action (mouse scroll), target (remote MacOS machine), key feature (automatic coordinate scaling), and implementation detail (environment variables). There's no wasted verbiage or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the tool's moderate complexity (remote control with coordinate scaling), no annotations, and no output schema, the description is somewhat complete but has gaps. It covers the what and how at a high level but lacks details about behavioral expectations, error handling, or return values. For a tool that performs remote actions, more context about reliability and failure modes would be beneficial.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, so the schema already fully documents all 5 parameters. The description adds minimal value beyond the schemaāit mentions 'automatic coordinate scaling' which relates to source_width/source_height parameters, but doesn't provide additional semantic context about parameter interactions or usage nuances. This meets the baseline 3 when schema coverage is high.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the specific action ('perform a mouse scroll'), target resource ('on a remote MacOS machine'), and key functionality ('with automatic coordinate scaling'). It distinguishes itself from sibling tools like mouse_click, mouse_move, and mouse_drag_n_drop by specifying the scroll action rather than click, move, or drag operations.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description implies usage context through 'remote MacOS machine' and 'environment variables for connection details', suggesting this tool is for remote control scenarios. However, it doesn't explicitly state when to use this versus alternatives like mouse_move or other mouse actions, nor does it provide exclusion criteria or prerequisites beyond the implied remote connection setup.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
remote_macos_open_applicationC
Opens/activates an application and returns its PID for further interactions.
| Name | Required | Description | Default |
|---|---|---|---|
| identifier | Yes | REQUIRED. App name, path, or bundle ID. |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries full burden. It mentions the action ('Opens/activates') and return value ('PID for further interactions'), but lacks details on behavioral traits such as error handling (e.g., if the app isn't found), permissions required, or whether it brings the app to foreground. This leaves significant gaps for a mutation tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is a single, efficient sentence that front-loads the core action and outcome with zero wasted words. Every part ('Opens/activates', 'returns its PID', 'for further interactions') adds value, making it appropriately concise.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity of a mutation tool (opening/activating apps) with no annotations and no output schema, the description is incomplete. It doesn't cover error cases, side effects, or the format of the PID return, which are critical for safe and effective use in a remote macOS context.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
The input schema has 100% description coverage, clearly documenting the single required parameter 'identifier' with its types. The description adds no additional parameter semantics beyond what the schema provides, such as examples or format details, so it meets the baseline for high schema coverage.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the action ('Opens/activates an application') and the resource ('an application'), with a specific outcome ('returns its PID for further interactions'). However, it doesn't explicitly differentiate from sibling tools like 'remote_macos_send_keys' which might also interact with applications, leaving room for minor ambiguity.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It doesn't mention prerequisites (e.g., needing the application installed), exclusions (e.g., not suitable for system apps), or how it relates to siblings like 'remote_macos_send_keys' for keyboard input after opening.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
remote_macos_send_keysC
Send keyboard input to a remote MacOs machine. Uses environment variables for connection details.
| Name | Required | Description | Default |
|---|---|---|---|
| text | No | Text to send as keystrokes | |
| special_key | No | Special key to send (e.g., 'enter', 'backspace', 'tab', 'escape', etc.) | |
| key_combination | No | Key combination to send (e.g., 'ctrl+c', 'cmd+q', 'ctrl+alt+delete', etc.) |
TDQS
Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?
With no annotations provided, the description carries the full burden of behavioral disclosure. It mentions using environment variables for connection details, which adds some context about authentication/configuration needs. However, it lacks critical behavioral information such as error handling, latency considerations, whether it's read-only or destructive, or any rate limitsāessential for a remote control tool.
Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.
Is the description appropriately sized, front-loaded, and free of redundancy?
The description is extremely concise with two sentences that directly convey the core functionality and a key implementation detail. Every word earns its place, and it is front-loaded with the primary purpose. There is no unnecessary elaboration or redundancy.
Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.
Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?
Given the complexity of a remote control tool with no annotations and no output schema, the description is incomplete. It fails to explain return values, error conditions, or behavioral traits like whether it's safe or destructive. The environment variable mention is helpful but insufficient for full contextual understanding, especially compared to richer sibling tools.
Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.
Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?
Schema description coverage is 100%, with clear descriptions for each parameter (text, special_key, key_combination). The description adds no additional parameter semantics beyond what the schema provides, such as examples of valid inputs or interactions between parameters. Since the schema does the heavy lifting, the baseline score of 3 is appropriate.
Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.
Does the description clearly state what the tool does and how it differs from similar tools?
The description clearly states the verb ('send keyboard input') and resource ('to a remote MacOs machine'), making the purpose immediately understandable. It distinguishes itself from sibling tools like mouse operations or screen capture by focusing on keyboard input. However, it doesn't explicitly differentiate from potential keyboard-related siblings that might exist elsewhere.
Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.
Does the description explain when to use this tool, when not to, or what alternatives exist?
The description provides no guidance on when to use this tool versus alternatives. It mentions environment variables for connection details, which hints at prerequisites, but offers no explicit usage context, exclusion criteria, or comparison with sibling tools like remote_macos_open_application that might involve keyboard input indirectly.
Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
8 tool updates
- First observed
remote_macos_get_screen - First observed
remote_macos_mouse_click - First observed
remote_macos_mouse_double_click - First observed
remote_macos_mouse_drag_n_drop - First observed
remote_macos_mouse_move - First observed
remote_macos_mouse_scroll - First observed
remote_macos_open_application - First observed
remote_macos_send_keys
TDQS
Scored across 8 tools
Every tool has a clearly distinct purpose targeting specific remote macOS control actions. Mouse operations are precisely differentiated (click, double-click, drag-and-drop, move, scroll), and other tools handle distinct functions like screen capture, application launching, and keyboard input. There is no functional overlap between tools.
All tools follow a perfectly consistent naming pattern: 'remote_macos_' prefix followed by a descriptive verb_noun combination (e.g., 'get_screen', 'mouse_click', 'send_keys'). This uniformity makes the tool set predictable and easy to understand at a glance.
With 8 tools, this server is well-scoped for remote macOS control, covering essential mouse, keyboard, screen, and application interactions. Each tool earns its place without redundancy, and the count is neither too sparse nor overwhelming for the domain.
The tool set provides strong coverage for basic remote control operations, including screen capture, mouse actions, keyboard input, and application management. A minor gap exists in lacking tools for more advanced interactions like file transfer, system information retrieval, or window management, but core workflows are well-supported.
Maintenance
Related MCP Connectors
Let ChatGPT, Claude & Cursor use your Mac: email, calendar, iMessage, Teams, files. Local, free.
Operate Linux, macOS and Windows from your LLM. Every action runs through an auditable allowlist.
Turns a phone into a camera+Bluetooth remote so AI assistants can see and control any PC.
Zero-setup MCP gateway securely connecting AI to your tools with authentication and workflows
Related MCP Servers
- AlicenseNot gradedqualityFmaintenanceEnables AI assistants to automate macOS desktop tasks including mouse control, keyboard input, screenshots, window management, and UI interaction.7 npm415MIT
- AlicenseBqualityDmaintenanceEmpowers AI agents to see, reason, and control computers via VNC, providing advanced vision features like OCR and image search, human-like input control, and optional SSH remote command execution.211MIT
- AlicenseNot gradedqualityDmaintenanceGives AI assistants full macOS desktop control via screenshots, mouse, keyboard, scrolling, and app management.311 npmMIT
- AlicenseAqualityDmaintenanceEnables AI agents to control macOS desktop apps via screenshots, mouse clicks, keyboard input, accessibility queries, and AppleScript.1114 npmMIT