Peggle AI MCP Server
Click on "Deploy Server".
Wait a few minutes for the server to deploy. Once ready, it will show a "Started" state.
In the chat, type
@followed by the MCP server name and your instructions, e.g., "@Peggle AI MCP Server Analyze the board and click where the best shot is."
That's it! The server will respond to your query, and you can continue using it as needed.
Here is a step-by-step guide with screenshots.
Peggle AI MCP Server
This MCP server allows an AI to play Peggle by capturing the screen and controlling the mouse.
Tools
capture_screen: Captures the primary monitor and returns the image as base64.click_at(x, y): Moves the mouse to (x, y) and performs a left click.
Related MCP server: vision-input
How to use with LM Studio
Build the server:
npm install && npm run buildConfigure LM Studio:
Open LM Studio and go to the MCP tab.
Click Add Server.
Set the command to
node(ensure node is in your PATH).Set the arguments to the absolute path of the built
index.js, for example:C:\Users\{youruser}\peggle-ai-mcp\dist\index.jsIf needed, you can use the mcp.json already included here and paste in the json contents to your mcp.json for it to work
Alternatively, use
npx:Command:
npxArguments:
-y C:\Users\maxwe\Desktop\peggle-ai-mcp
Start Playing:
Open Peggle (make sure it's on your primary monitor).
In LM Studio, select a model that supports vision and tools (e.g., Ministral 3B, or any other vision-capable model).
Ask the AI: "Take a screenshot of Peggle, analyze where the best shot is, and click there."
Implementation Details
Screen Capture: Uses
screenshot-desktop.Mouse Control: Uses PowerShell commands via
child_processfor cross-platform compatibility on Windows without needing native build tools.Protocol: Model Context Protocol (MCP).
Note on Windows 11
Ensure that PowerShell execution policy allows running the commands if you encounter issues. The server uses standard PowerShell calls that should work in most default configurations
Available Tools
2 toolscapture_screenB
Captures a screenshot of the primary monitor and returns it as a base64 encoded string.
Inputs: no named parameters.
click_atB
Moves the mouse to the specified coordinates and performs a left click.
Inputs: x (required), y (required).
Tool Schema Changelog
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
TDQS
Scored across 2 tools
The two tools have completely distinct purposes: one captures visual data from the screen, while the other performs a mouse interaction at specific coordinates. There is no overlap in functionality, making it impossible to confuse them.
Both tools follow a consistent verb_noun pattern with snake_case naming: capture_screen and click_at. The naming is clear, predictable, and adheres to the same convention throughout.
With only two tools, the server feels thin for a general-purpose automation or interaction domain like screen capture and mouse control. Key operations such as keyboard input, drag-and-drop, or region-specific screenshots are missing, limiting the scope significantly.
For a server implied to handle desktop automation or interaction (based on screen capture and mouse click), there are significant gaps. Missing tools include keyboard input, mouse movement without clicking, drag operations, and more advanced screen interactions, which will likely cause agent failures in broader automation tasks.
Maintenance
Related MCP Connectors
Let your AI agent see any public web page: one screenshot tool, returns the page as an image.
Playwright browser automation — navigate, click, fill forms, extract, screenshot — 17 agent tools.
Real mobile game screens and full player flows from top games, for coding agents.
Give your agent eyes: screenshots of any web page it can see, pages as markdown, and PDFs.
Related MCP Servers
- FlicenseNot gradedqualityDmaintenanceEnables LLMs to take full control of your device by providing screen automation tools for capturing, clicking, typing, and scrolling, ideal for automation and education.55-
- FlicenseNot gradedqualityDmaintenanceEnables AI to capture screenshots and control mouse and keyboard for automated desktop interaction.-
- AlicenseNot gradedqualityCmaintenanceEnables AI assistants and MCP clients to control an auto-clicker, query cursor position, and locate UI elements via image matching or OCR text search.MIT
- AlicenseNot gradedqualityCmaintenanceEnables AI agents to capture multi-monitor screenshots with coordinate grids and perform mouse, keyboard, scrolling, dragging, and window-management actions on Windows via MCP tools or CLI. It provides pixel-accurate desktop automation for computer-use agents.MIT