Skip to main content
Glama
bradthebeeble

mcp-macos-cua

mcp-macos-cua

A macOS Computer Use Agent (CUA) — an MCP server that gives AI agents full GUI automation capabilities on macOS.

Control any desktop app through screenshots, mouse clicks, keyboard input, accessibility queries, and AppleScript.

Optimized for Claude Code — includes a ready-to-use /cua skill with automatic permission bootstrap. Also works as a standalone MCP server with any MCP-compatible agent.

Features

Tool

Description

screenshot

Capture full screen or specific app window (auto-detects display scale factor)

open_app

Open and activate any macOS application

click

Click at screen coordinates (single, double, left, right)

type_text

Type text into the frontmost app

key_press

Press keys/combos (cmd+c, cmd+shift+a, return, etc.)

scroll

Scroll in any direction at current or given position

get_ui_elements

Inspect accessibility tree of an app window

click_ui_element

Click buttons/elements by name via accessibility

run_applescript

Execute arbitrary AppleScript

get_mouse_position

Get current cursor position

move_mouse

Move cursor to coordinates

Related MCP server: macos-desktop-control

Prerequisites

  • macOS (required — uses macOS-specific APIs)

  • Node.js 18+

  • cliclickbrew install cliclick

  • Accessibility permissions — System Settings > Privacy & Security > Accessibility (grant to your terminal app)

  • Screen Recording permissions — System Settings > Privacy & Security > Screen Recording (grant to your terminal app)

  • Python 3 with pyobjc-framework-Quartz — usually pre-installed on macOS; if not: pip3 install pyobjc-framework-Quartz

You may need to restart your terminal after granting macOS permissions.


Installation

The plugin gives you the full experience: an MCP server, a /cua skill with guided CUA loop, and automatic permission bootstrap.

From the marketplace — run these commands inside Claude Code:

/plugin marketplace add bradthebeeble/claude-plugins
/plugin install mcp-macos-cua@bradthebeeble-plugins

From local source — for development/testing (from the shell):

claude --plugin-dir /path/to/mcp-macos-cua

After installing, start using it immediately:

/mcp-macos-cua:cua open Safari and search for today's weather

Auto-permissions: On first use, the /cua skill detects whether CUA tool permissions are configured. If not, it asks once to allow all CUA tools — no more per-tool prompts for the rest of the project.

Option B: Any MCP-Compatible Agent (npx)

The MCP server is published on npm and works with any agent that supports the Model Context Protocol — no plugin system required.

Add this to your MCP client config:

{
  "mcpServers": {
    "cua": {
      "command": "npx",
      "args": ["-y", "mcp-macos-cua"]
    }
  }
}

npx downloads the package and all dependencies automatically on first run, and caches them for subsequent calls.

Where to put this config:

Agent

Config location

Claude Code

.mcp.json in your project root

Cursor

Settings > MCP > Add server

Windsurf

MCP settings

Claude Desktop

claude_desktop_config.json

Custom

Your MCP client config file

Note for Claude Code users: Using the MCP server directly (without the plugin) gives you the raw tools but not the /cua skill, the guided CUA loop, or the auto-permission bootstrap. To avoid per-tool permission prompts, add "mcp__cua__*" to permissions.allow in .claude/settings.local.json.

Option C: Clone and Run

For development or when you want to run the server directly:

git clone https://github.com/bradthebeeble/mcp-macos-cua.git
cd mcp-macos-cua
npm install
node server/index.js

The server communicates via stdio — connect your MCP client to the process.


System Prompt for Non-Plugin Usage

When using the MCP server without the Claude Code plugin (Options B or C), your agent needs instructions on how to use the tools effectively. Add this to your agent's system prompt:

You are a Computer Use Agent (CUA) on macOS. Interact with the GUI using the cua MCP tools.

## CUA Loop
1. Screenshot - Take a screenshot to see current state
2. Analyze - Determine what action to take next
3. Act - Use the appropriate tool (click, type_text, key_press, etc.)
4. Verify - Screenshot again to confirm it worked
5. Repeat or Report - Continue or summarize results

## Coordinate System
The screenshot tool returns a display scale factor (e.g. 2x for Retina, 1x for standard).
Divide screenshot pixel positions by this scale factor to get correct tool coordinates.
Example: if scale factor is 2x and you see a button at pixel (800, 400) in the screenshot,
click at coordinates (400, 200).

## Available Tools
- screenshot - Capture screen (optionally a specific app)
- open_app - Open and activate an application
- click - Click at coordinates (x, y in screen points)
- type_text - Type text into frontmost app
- key_press - Press keys/combos (e.g. "cmd+c", "return", "cmd+shift+a")
- scroll - Scroll in a direction at a position
- get_ui_elements - Inspect accessibility tree of an app
- click_ui_element - Click an element by name via accessibility
- run_applescript - Execute arbitrary AppleScript
- get_mouse_position - Get current cursor position
- move_mouse - Move cursor to coordinates

## Tips
- Always start with a screenshot before acting
- Prefer click_ui_element (accessibility) over coordinate click when possible
- Use get_ui_elements to discover clickable elements by name
- Use key_press for keyboard shortcuts (faster than navigating menus)
- Use scroll with x,y to scroll within a specific area
- Use run_applescript as escape hatch for complex multi-step automation

Usage

The CUA Loop

Whether via the /cua skill or a custom system prompt, the agent follows a Screenshot > Analyze > Act > Verify > Repeat loop:

  1. Takes a screenshot to see the current screen state

  2. Analyzes what action to take next

  3. Executes the action (click, type, etc.)

  4. Takes another screenshot to verify the result

  5. Repeats until the task is complete

Coordinate System

The screenshot tool automatically detects the display scale factor (2x for Retina, 1x for standard displays) and returns it with every screenshot. Divide screenshot pixel positions by this factor to get correct tool coordinates.

Examples (Claude Code plugin)

/mcp-macos-cua:cua open Slack and send "hello" to the #general channel
/mcp-macos-cua:cua take a screenshot of Safari
/mcp-macos-cua:cua open Notes and create a grocery list
/mcp-macos-cua:cua open System Settings and enable Dark Mode

Tools Reference

screenshot

Param

Type

Required

Description

app

string

No

App name to screenshot. Omit for full screen.

Returns the screenshot image and the display scale factor.

click

Param

Type

Required

Description

x

number

Yes

X coordinate in screen points

y

number

Yes

Y coordinate in screen points

clicks

number

No

1 (single) or 2 (double). Default: 1

button

string

No

"left" or "right". Default: "left"

type_text

Param

Type

Required

Description

text

string

Yes

Text to type into frontmost app

key_press

Param

Type

Required

Description

keys

string

Yes

Key combo like "cmd+c", "return", "cmd+shift+a"

scroll

Param

Type

Required

Description

direction

string

Yes

"up", "down", "left", "right"

amount

number

No

Scroll steps. Default: 3

x, y

number

No

Coordinates to scroll at (moves mouse first)

open_app

Param

Type

Required

Description

app

string

Yes

Application name (e.g. "Safari", "Slack")

get_ui_elements

Param

Type

Required

Description

app

string

Yes

Application process name

depth

string

No

"shallow" (default) or "deep" (full tree, slow)

click_ui_element

Param

Type

Required

Description

app

string

Yes

Application process name

element_type

string

Yes

e.g. "button", "menu item", "text field"

name

string

Yes

Name/title of the element

path

string

No

Parent path. Default: "window 1"

run_applescript

Param

Type

Required

Description

script

string

Yes

AppleScript code to execute

get_mouse_position

No parameters. Returns current cursor position.

move_mouse

Param

Type

Required

Description

x

number

Yes

X coordinate in screen points

y

number

Yes

Y coordinate in screen points


Adding to a Team Marketplace

To distribute the Claude Code plugin within your team, add it to a Claude Code plugin marketplace:

  1. Create or locate your team's marketplace.json

  2. Add the plugin entry:

{
  "plugins": [
    {
      "name": "mcp-macos-cua",
      "description": "macOS Computer Use Agent - GUI automation via screenshots, clicks, typing, accessibility, and AppleScript",
      "source": "github:bradthebeeble/mcp-macos-cua"
    }
  ]
}
  1. Team members can then install from inside Claude Code:

/plugin marketplace add your-org/your-marketplace-repo
/plugin install mcp-macos-cua@your-marketplace

Troubleshooting

"cliclick not found" — Install with brew install cliclick

Clicks land in wrong position — Check the scale factor returned by screenshot. Divide pixel coordinates by that factor.

"not allowed assistive access" — Grant Accessibility permissions in System Settings > Privacy & Security > Accessibility to your terminal app. Restart the terminal after granting.

Scroll not working — Install pyobjc: pip3 install pyobjc-framework-Quartz

Permission prompts on every CUA tool call (Claude Code) — The auto-permission bootstrap only runs via the /cua skill (plugin install). If using manual MCP config, add "mcp__cua__*" to permissions.allow in .claude/settings.local.json.

MCP server not starting — Verify npx -y mcp-macos-cua runs from your terminal. Check that Node.js 18+ is installed.


Security

This tool has full GUI control over your Mac. It can click, type, and run AppleScript as your user. Only use it in trusted environments and review what the agent is doing via the screenshot-verify loop.

License

MIT

Available Tools

11 tools
clickA

Click at screen coordinates (in points). Use screenshot to determine positions — on Retina displays, divide screenshot pixel coordinates by 2.

ParametersJSON Schema
NameRequiredDescriptionDefault
xYesX coordinate in screen points
yYesY coordinate in screen points
buttonNoMouse buttonleft
clicksNoNumber of clicks (1=single, 2=double)

TDQS

A4/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided; description adds Retina coordinate conversion but lacks details on blocking behavior, failure modes, or off-screen coordinates.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two short sentences that state purpose and provide a critical hint, with no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Simple tool with no output schema; description covers main functionality and coordinate system. Could mention input validation or immediate nature, but adequate.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema covers all 4 parameters with descriptions (100% coverage), and the description adds extra value by clarifying coordinate conversion for Retina displays, which isn't in the schema.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states the action 'Click at screen coordinates (in points)' and distinguishes from siblings like move_mouse and click_ui_element by specifying coordinate-based clicking with Retina conversion hint.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Gives practical advice to 'use screenshot to determine positions' but does not explicitly exclude scenarios or mention alternatives like click_ui_element for UI-based clicks.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

click_ui_elementC

Click a named UI element (button, menu item, etc.) within an app window using accessibility

ParametersJSON Schema
NameRequiredDescriptionDefault
appYesApplication process name
nameYesName/title of the element to click
pathNoOptional parent path like 'group 1 of group 2 of window 1'. Defaults to 'window 1'.
element_typeYesUI element type: button, menu item, text field, checkbox, etc.

TDQS

C2.8/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description must disclose behavioral traits. It only states the basic action without mentioning error handling, element visibility requirements, or whether it scrolls or waits. Minimal transparency.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness3/5

Is the description appropriately sized, front-loaded, and free of redundancy?

A single 14-word sentence is concise but lacks essential detail for a tool with 4 parameters. It is front-loaded but under-specified for effective use.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the complexity of UI element interaction and the absence of output schema or annotations, the description is incomplete. It does not explain return values, error cases, or how to handle missing elements.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema covers all 4 parameters with descriptions, so baseline is 3. The description adds no additional meaning beyond what the schema already provides.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states it clicks a named UI element using accessibility, specifying the verb, resource, and method. It distinguishes from coordinate-based 'click' by mentioning accessibility, but does not explicitly differentiate from other interaction tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool vs alternatives like 'click', 'type_text', or 'get_ui_elements'. The description lacks prerequisites, when-not-to-use, or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_mouse_positionA

Get the current mouse cursor position in screen points

ParametersJSON Schema
NameRequiredDescriptionDefault

No parameters

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations provided, but the description sufficiently discloses the read-only nature and output format (screen points). No side effects or contradictions.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, front-loaded with key action and resource, no wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no parameters, no output schema, and simple nature, the description is nearly complete. Lacks explicit return type specification but sufficient for typical use.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters4/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Zero parameters, so baseline is 4. Description adds no parameter info, but none are needed.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Get' and resource 'current mouse cursor position', specifying units (screen points) to differentiate from sibling tools like move_mouse.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description implies usage when needing cursor coordinates, but provides no explicit context on when to use vs. alternatives, nor any exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

get_ui_elementsB

Get accessibility UI elements of a window for a given app. Useful for finding buttons, text fields, etc.

ParametersJSON Schema
NameRequiredDescriptionDefault
appYesApplication process name
depthNo'shallow' for top-level elements, 'deep' for full tree (can be slow)shallow

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It mentions the 'depth' parameter can be slow for 'deep' but does not disclose other behavioral traits like permissions required, whether data is cached, or impact on the target application. A read-only tool, but no explicit guarantee of non-destructiveness.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences long, front-loaded with the core function, and the second sentence adds context. No wasted words, but could be more structured (e.g., bullet points for parameter details). Still, it is efficient.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the absence of an output schema, the description should hint at the return format. It does not mention that it returns a tree of elements with properties like role, name, etc. The reference to siblings like click_ui_element provides some context for usage flow, but completeness for a retrieval tool is lacking.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100%, so the schema already documents both parameters. The description adds minimal value: for 'app', it repeats 'application process name', and for 'depth', it adds 'can be slow' to the schema's 'full tree' description. This is marginal improvement, meeting the baseline of 3.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses a specific verb 'Get accessibility UI elements of a window for a given app', clearly identifying the resource (UI elements of a window) and scope (per app). It distinguishes from sibling tools like click_ui_element, which interacts with elements, and get_mouse_position, which reads mouse coordinates.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines3/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description states it is 'useful for finding buttons, text fields, etc.', implying it is for exploration before interaction. However, no explicit guidance on when not to use or alternatives is provided, though sibling tools suggest context. This is minimally adequate but lacks precise conditions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

key_pressA

Press a key or key combination (e.g. 'return', 'escape', 'cmd+c', 'cmd+shift+l')

ParametersJSON Schema
NameRequiredDescriptionDefault
keysYesKey combo like 'return', 'escape', 'tab', 'cmd+c', 'cmd+shift+a', 'up', 'down', 'pagedown', 'pageup'

TDQS

A4.1/5.0
Behavior3/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are present, so the description carries the full burden. It discloses that it presses keys but doesn't elaborate on potential side effects (e.g., system focus, modifier behavior). However, it's not misleading.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence, efficiently communicates the purpose and example inputs. No wasted words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness5/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the simplicity of the tool (single parameter, no output schema, no nested objects), the description is complete. It provides all necessary information for an agent to invoke it correctly.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Only one parameter 'keys' exists, and the schema already describes it with examples. The tool description adds a few more examples (e.g., 'cmd+shift+l'), but adds minimal value beyond the schema. Schema coverage is 100%.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the tool presses a key or key combination, with specific examples like 'return', 'escape', 'cmd+c'. This distinguishes it from sibling tools like type_text (which types text) and click (which clicks).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explains when to use the tool (press a key/combination). While it doesn't explicitly exclude alternatives, the sibling context makes it clear. Could be improved by mentioning when type_text might be more appropriate.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

move_mouseC

Move mouse cursor to given screen coordinates

ParametersJSON Schema
NameRequiredDescriptionDefault
xYesX coordinate
yYesY coordinate

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must carry the full burden of behavioral disclosure. It only states the action but omits details like whether movement is instant or animated, border behavior, or any side effects. This leaves the agent uncertain about the tool's full impact.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single concise sentence with no superfluous words. However, it omits important details that could be added without sacrificing conciseness.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given the lack of output schema, annotations, and the presence of sibling tools, the description is too brief. It does not provide essential context such as coordinate system, units, or expected behavior, making it insufficient for an agent to use the tool correctly without additional knowledge.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters2/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The input schema provides basic parameter descriptions ('X coordinate', 'Y coordinate'), and the tool description adds no extra meaning. It does not specify units, coordinate system, valid range, or coordinate origin, leaving significant ambiguity despite 100% schema coverage.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description uses the specific verb 'move' and resource 'mouse cursor to given screen coordinates', clearly stating the action and target. It distinguishes this tool from sibling tools like 'click' (which also moves) and 'get_mouse_position' (which reads the position).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives, no prerequisites, and no conditions under which it should not be used. It does not explain the coordinate system (e.g., screen vs. window, origin) or whether coordinates must be within screen bounds.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

open_appB

Open and activate a macOS application

ParametersJSON Schema
NameRequiredDescriptionDefault
appYesApplication name (e.g. 'Slack', 'WhatsApp', 'Safari')

TDQS

B3.3/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose behavioral traits. It only says 'Open and activate' without detailing behavior if the app is already running, how the app is identified (name vs. bundle ID), or potential side effects.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Single sentence with no wasted words. Front-loaded with the core action and resource.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness3/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The description is adequate for a simple tool with one parameter and no output schema, but it lacks details on error handling, app identification precision, and behavior for non-existing apps.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% with a parameter description that already includes examples. The tool description does not add significant meaning beyond the schema, though the examples (e.g., 'Slack') are helpful. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states the verb 'Open and activate' and the resource 'macOS application', making it distinct from sibling tools like type_text or move_mouse.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives (e.g., run_applescript or click). The description does not specify prerequisites or exclusions.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

run_applescriptA

Run arbitrary AppleScript for complex automation that other tools don't cover

ParametersJSON Schema
NameRequiredDescriptionDefault
scriptYesAppleScript code to execute

TDQS

A3.6/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, so the description carries full burden. It only says 'Run arbitrary AppleScript' without disclosing potential side effects (e.g., destructive actions, security risks, blocking behavior). The agent is left uninformed about execution consequences.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

One sentence with zero wasted words. It is front-loaded with the action and purpose, directly conveying the tool's value.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

With only one parameter and no output schema or annotations, the description is too minimal. It omits important context like what the script returns, error handling, security warnings, and prerequisite conditions, which are critical for a tool that executes arbitrary code.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and already describes 'script' as 'AppleScript code to execute'. The description adds no new meaning beyond that, just rephrases the tool's action. Baseline 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Description clearly states 'Run arbitrary AppleScript' (verb+resource) and distinguishes from sibling tools by specifying 'for complex automation that other tools don't cover', indicating it handles cases beyond specific UI automation tools.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

Description implies this tool is for tasks not covered by sibling tools like type_text, move_mouse, etc., but does not explicitly state when not to use it or provide direct alternatives. The guidance is clear but implicit.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

screenshotA

Take a screenshot of the entire screen or a specific app window. Returns the image and the display scale factor (divide screenshot pixel coordinates by this factor to get tool coordinates).

ParametersJSON Schema
NameRequiredDescriptionDefault
appNoApp name to screenshot. If omitted, captures full screen.

TDQS

A4.2/5.0
Behavior4/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

With no annotations, the description must disclose all behavioral traits. It reveals that the tool returns an image and a scale factor, and explains how to use the scale factor for coordinate mapping. It does not mention potential permissions (e.g., screen recording) or image format, but the key behavioral nuance is covered.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is two sentences, front-loading the action and providing essential detail efficiently. No extraneous words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

The tool is low-complexity. Although there is no output schema, the description adequately explains the return values (image and scale factor) and their usage. It lacks details on image format or resolution, but this is not critical for basic usage.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

The single parameter 'app' is well-documented in the schema (100% coverage). The description adds no additional meaning beyond the schema description, so baseline score of 3 is appropriate.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly states 'Take a screenshot of the entire screen or a specific app window', specifying the action and resource. It distinguishes from sibling tools (none are screenshot-related).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines4/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description explains when to use the optional 'app' parameter ('If omitted, captures full screen'), providing clear conditional usage. No explicit exclusions or alternatives are given, which is acceptable for a simple tool.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

scrollC

Scroll at the current mouse position or at given coordinates

ParametersJSON Schema
NameRequiredDescriptionDefault
xNoX coordinate to scroll at (moves mouse first)
yNoY coordinate to scroll at (moves mouse first)
amountNoNumber of scroll steps
directionYesScroll direction

TDQS

C2.9/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

No annotations are provided, and the description only states basic behavior. It does not disclose whether scrolling is smooth or discrete, whether it triggers events, or what happens if coordinates are out of bounds. The description carries the full burden but is insufficient.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness4/5

Is the description appropriately sized, front-loaded, and free of redundancy?

The description is a single, front-loaded sentence with no wasted words. It is efficient, though could benefit from a touch more detail without becoming verbose.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness2/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

Given no annotations, no output schema, and siblings that are UI interaction tools, the description lacks important context such as whether a window must be focused, what scrolleable elements it works on, and any side effects. It is incomplete for reliable agent invocation.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Input schema has 100% coverage with descriptions for all 4 parameters. The tool description adds little beyond the schema, only clarifying that x and y are for coordinates to scroll at. Baseline 3 is appropriate as the description does not significantly enhance parameter understanding.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose4/5

Does the description clearly state what the tool does and how it differs from similar tools?

The description clearly identifies the action (scroll) and the target (mouse position or coordinates). It distinguishes the tool from siblings by focusing on scrolling, but could be more specific about what is being scrolled (e.g., active window or content under cursor).

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

The description provides no guidance on when to use this tool versus alternatives like move_mouse, click, or keyboard actions. It does not mention prerequisites or limitations.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

type_textB

Type text using the keyboard. The frontmost app receives the input.

ParametersJSON Schema
NameRequiredDescriptionDefault
textYesText to type

TDQS

B3.4/5.0
Behavior2/5

Does the description disclose side effects, auth requirements, rate limits, or destructive behavior?

Lacks annotations, so description must carry behavioral information. It mentions 'frontmost app receives input' but omits details about special characters, latency, or error handling.

Agents need to know what a tool does to the world before calling it. Descriptions should go beyond structured annotations to explain consequences.

Conciseness5/5

Is the description appropriately sized, front-loaded, and free of redundancy?

Two concise sentences, front-loaded with the core action, no unnecessary words.

Shorter descriptions cost fewer tokens and are easier for agents to parse. Every sentence should earn its place.

Completeness4/5

Given the tool's complexity, does the description cover enough for an agent to succeed on first attempt?

For a simple tool with one parameter and no output schema, the description is mostly complete, though could mention return behavior or side effects.

Complex tools with many parameters or behaviors need more documentation. Simple tools need less. This dimension scales expectations accordingly.

Parameters3/5

Does the description clarify parameter syntax, constraints, interactions, or defaults beyond what the schema provides?

Schema coverage is 100% and description adds no new meaning beyond the schema's 'Text to type' description. Baseline 3 applies.

Input schemas describe structure but not intent. Descriptions should explain non-obvious parameter relationships and valid value ranges.

Purpose5/5

Does the description clearly state what the tool does and how it differs from similar tools?

Clearly states 'Type text using the keyboard' with a specific verb and resource, and distinguishes from sibling tools like key_press which handles key combos.

Agents choose between tools based on descriptions. A clear purpose with a specific verb and resource helps agents select the right tool.

Usage Guidelines2/5

Does the description explain when to use this tool, when not to, or what alternatives exist?

No guidance on when to use this tool versus alternatives like key_press or click_ui_element. Agent must infer from name and description alone.

Agents often have multiple tools that could apply. Explicit usage guidance like "use X instead of Y when Z" prevents misuse.

Tool Schema Changelog

Recent tool additions, removals, and schema changes observed during successful MCP inspections.

  1. 11 tool updatesv1.2.0
    • First observedclick
    • First observedclick_ui_element
    • First observedget_mouse_position
    • First observedget_ui_elements
    • First observedkey_press
    • First observedmove_mouse
    • First observedopen_app
    • First observedrun_applescript
    • First observedscreenshot
    • First observedscroll
    • First observedtype_text

TDQS

A3.7/5.0

Scored across 11 tools

Disambiguation5/5

Each tool has a clearly distinct purpose. Even overlapping tools like click and click_ui_element are differentiated by coordinate-based vs accessibility-based interaction.

Naming Consistency5/5

All tool names follow a consistent verb_noun pattern with underscores (e.g., type_text, get_ui_elements). No mixed conventions.

Tool Count5/5

11 tools is well-scoped for macOS UI automation, covering common actions without being overwhelming.

Completeness4/5

Covers core operations (typing, clicking, scrolling, screenshots, app opening, accessibility, AppleScript). Minor gaps like window management or drag-and-drop, but strong overall.

Maintenance

ActivityInactive
ResponsivenessNo issues

Related MCP Connectors

Related MCP Servers

  • A
    license
    Not graded
    quality
    F
    maintenance
    Enables AI assistants to automate macOS desktop tasks including mouse control, keyboard input, screenshots, window management, and UI interaction.
    7 npm
    415
    MIT
  • A
    license
    Not graded
    quality
    D
    maintenance
    Provides native macOS desktop automation for AI agents, enabling screen capture, mouse/keyboard control, window management, and iOS/Android simulator control in both foreground and background modes without focus stealing.
    3
    MIT
  • A
    license
    Not graded
    quality
    C
    maintenance
    Enables AI agents to control macOS applications through the Accessibility API, AppleScript, and CGEvents, providing structured text output of UI elements and actions without needing screenshots.
    MIT