Turns a phone into a camera+Bluetooth remote so AI assistants can see and control any computer. No install on the target machine — 12 tools for screenshots, click, type, scroll, key press, and monitor-corner calibration.
Scored across 12 tools
Each tool targets a distinct action: clicks, screenshots (raw, corrected, calibration aids), keyboard input, mouse movement, scrolling, and corner calibration. There is no ambiguity between tools.
Tool names mix conventions: some are single verbs (click, scroll, key), some are verb_noun (move_mouse, set_corners, type_text), and some are longer phrases (take_screenshot_with_crosshair). Although readable, the inconsistency is notable.
With 12 tools, the server covers all essential interactions for camera-based screen control without being bloated or sparse. Each tool has a clear role.
The tool set covers clicking, typing, key combinations, mouse movement, scrolling, and multiple screenshot modes including calibration aids. Missing drag/swipe functionality is a minor gap.
Click at normalized screen coordinates.
nx, ny: float 0.0000–1.0000 where (0,0) = top-left, (1,1) = bottom-right.
Inputs: nx (required), ny (required). Returns: result
Double-click at normalized screen coordinates.
Inputs: nx (required), ny (required). Returns: result
Get the phone's current screen-corner calibration.
Returns {"tl": [nx,ny], "tr": [nx,ny], "br": [nx,ny], "bl": [nx,ny]} — each corner
is a normalized point (0.0–1.0) in the RAW camera frame, defining the perspective
warp that maps the camera view onto a flat rectangle representing the monitor.
These four points are an arbitrary quadrilateral (trapezoid), not a bounding box —
adjust one corner at a time without assuming the others move symmetrically.
Inputs: no named parameters.
Capture the RAW camera frame — no perspective warp, no crop to the calibrated
screen quad. Use this to see exactly what the camera sees before any correction,
e.g. when troubleshooting why take_screenshot looks wrong, or before adjusting
corners with get_corners/set_corners.
Inputs: no named parameters.
Press a key combination.
modifiers bitmask: LCtrl=1, LShift=2, LAlt=4, LWin=8
Common keycodes: Enter=40, Escape=41, Tab=43, Space=44,
F4=61, PageDown=78, PageUp=75, Win=227
Examples:
Alt+F4 → key(4, [61])
Ctrl+W → key(1, [26])
Inputs: keycodes (required), modifiers (required). Returns: result
Move mouse cursor to normalized coordinates WITHOUT clicking.
nx, ny: float 0.0000–1.0000.
Inputs: nx (required), ny (required). Returns: result
Scroll the mouse wheel.
delta: number of ticks. Positive = scroll down, negative = scroll up.
Inputs: delta (required). Returns: result
Update the phone's screen-corner calibration.
Each corner is [nx, ny] normalized 0.0–1.0 in the raw camera frame.
tl/tr/br/bl = top-left/top-right/bottom-right/bottom-left of the monitor as seen
by the camera (an arbitrary trapezoid due to perspective — not a rectangle).
Call get_corners() first to read the current values before nudging one of them.
Inputs: bl (required), br (required), tl (required), tr (required). Returns: result
Capture the current screen via the Dittu phone camera. Returns a JPEG image. Call this to see what's on screen before acting.
Inputs: no named parameters.
Capture the screen, crop tightly around (nx, ny), zoom in, and draw a crosshair
at exactly that expected position.
Use this for screen-corner calibration: move_mouse(nx, ny) near a screen edge,
then call this to see whether the actual cursor lines up with the crosshair
(where it SHOULD be if calibration is perfect). If the cursor is offset from the
crosshair, or missing entirely (edge is cropped out of frame), corners need
adjusting — see get_corners/set_corners.
nx, ny: the same coordinates you passed to move_mouse.
zoom: magnification factor for the cropped region (default 4x).
Inputs: nx (required), ny (required), zoom.
Capture the screen and overlay a coordinate grid.
step: grid spacing (default 0.1, use 0.05 for finer grid on small UI elements).
Returns a JPEG image with grid drawn on top.
Inputs: step.
Recent tool additions, removals, and schema changes observed during successful MCP inspections.
Loading tool schema changelog…
Add one secure layer between your agents and this server.