"Server for MCP Protocol with On-Screen UI Interaction" matching MCP servers:

A local MCP server for Windows that gives Claude control of your screen, enabling screen viewing, image-based element finding, clicking/typing, macro recording and replaying, and scheduled automation with failsafe safety features.

Enables AI agents to start and stop full-screen recordings on macOS using FFmpeg, with control over quality, FPS, and audio.

Enables LLMs to capture screenshots and screen recordings through MCP with chunked session-based transfers for reliable image consumption. Supports multi-monitor selection, timeline capture, and compatibility with both vision and non-vision language models.

Enables AI assistants to search and retrieve encrypted local screen history, including OCR text, recent activity, context around moments, daily rollups, and screen snapshots.

Enables MCP clients to start and stop local read-only Windows 11 screen observation sessions, then inspect redacted screen state, UI trees, frames, and wait for changes, title matches, or idle periods through stdio tools.

Enables AI assistants to capture screenshots and control desktop input (mouse, keyboard) to see and interact with your screen. Features user-first safety controls including automatic pause on user activity and app allowlists to restrict interactions to approved applications only.

Enables AI agents to see, locate UI elements, and operate any Windows desktop app through natural language, using accessibility-tree matching with optional vision-model fallback, plus an autonomous visual loop with introspection and meta-learning.

An MCP server that gives a model eyes and hands on a Linux Wayland desktop, enabling screenshot capture, mouse/keyboard control, OCR, and icon detection via OmniParser.

A Windows desktop automation MCP server that enables UI recognition through OCR, UIA controls, and multi-point color matching. It allows agents to interact with desktop applications via actions like clicking and typing while using a learning system to track and improve operation success.

Enables an AI assistant to list available monitors and take a single on-demand still screenshot of a selected monitor, with optional downscaling and JPEG or PNG output.

Enables any AI agent to perceive and control a Windows desktop through live screen capture, OCR, and safety-gated mouse/keyboard actions via a local HTTP API and MCP.

Enables screen capture, OCR text extraction, and automated clicking on macOS through MCP. Supports fullscreen, window, and region capture with optional text recognition and monitoring.

Provides screen capture and optical character recognition (OCR) capabilities for entire displays or specific application windows. It enables users to list running applications, take screenshots, and extract text from images using multi-language support.

A high-performance, cross-platform MCP server for split-screen window management on Windows and macOS, providing 16 window manipulation tools.

Enables MCP clients to view the user's screen and draw click-through annotations, highlights, and numbered step indicators directly on the live desktop, while keeping the user in control of mouse and keyboard.

An MCP server that enables viewing all screens and controlling mouse and keyboard, allowing clicks anywhere and text input.

Enables Claude to capture and analyze screen content across Windows, macOS, and Linux with zero native runtime dependencies.

An MCP server that lets AI assistants see your macOS desktop, capture screenshots, read browser tabs, and preview files via local macOS tools.

Enables local Windows UI automation and screen capture, targeting windows that are difficult to automate such as games and legacy apps, with tools for window management, mouse and keyboard input, and desktop capture.

Enables ChatGPT to access approved local Windows folders, run commands, control the desktop, and manage session history through a permission-bounded MCP server.