Little Mouse Pointer

English README

This repository provides Little Mouse Pointer: a Windows desktop UI context picker for AI agents. Users can select windows, UI elements, or screen regions with the mouse, obtain context via UI Automation, screenshots, and native OCR, and after confirmation, provide it to OpenAI Codex, DeepSeek Harness, or other compatible clients through MCP.

The plugin directory is plugins/little-mouse-pointer. See the README in the plugin directory for full features, protocol, and runtime instructions.

Documentation Navigation

• Getting Started Tutorial: the complete flow for first installation, first selection, and common issues.

• Installation Checklist for Beginners: confirm item by item for Codex, DeepSeek Harness, and manual run scenarios.

• Plugin Full README: features, usage flow, privacy limitations, and failure boundaries.

• Runtime Notes: self-contained runtime package, run.ps1, and MCP stdio behavior.

• DeepSeek Harness Configuration: manual Cordis configuration when the bundle is unavailable.

• Protocol Notes: tool output fields and confirmation flow.

Related MCP server: Computer-Controller-Bridg

Installing from GitHub into Codex

Run the following command in PowerShell, replacing OWNER/REPOSITORY with the actual GitHub repository:

codex plugin marketplace add OWNER/REPOSITORY --ref main
codex plugin add little-mouse-pointer@auto-mouse

If you only need to download the plugin directory, you can use the GitHub release zip, or install the plugins/little-mouse-pointer layer locally. Do not mistake the repository root for the direct plugin root.

Connecting to DeepSeek Harness

Copy the Chinese installation checklist or the English installation checklist, then refer to the DeepSeek Harness Configuration and change the paths to your actual directories. MCP stdio must be launched directly:

plugins/little-mouse-pointer/app/MousePointer.Windows.exe

Do not use run.ps1 as an MCP stdio bridge; run.ps1 is only for manually launching the GUI and self-test.

Installing the Harness bundle directly from GitHub

The repository root also provides an installation package conforming to the Harness dsh.bundle specification. It is recommended to pin a release tag:

dsh plugin --profile demo add github:Fish121380/auto-mouse#v0.1.1
dsh --profile demo --dump-config

The bundle automatically locates the Windows x64 exe it carries and registers @deepseek-ai/dsh-mcp-client. It only works on Windows x64; the port can be overridden in the profile's cordis.patch.yml:

- replace:
    - id: little-mouse-pointer
      config:
        port: 49154

Pre-installation Checks

• Windows 10/11 x64.

• No .NET installation required; the release package is self-contained.

• Keep all files in plugins/little-mouse-pointer/app.

• The default port is 49153; the endpoint and MOUSE_POINTER_HTTP_PORT must match.

• Close old Little Mouse Pointer instances before running Codex/Harness.

• The MCP tools are ui_context_pick, ui_context_current, ui_context_clear.