Current PS5 screen as a JPEG (scaled to max_width; the source is 1920x1080).

Press and release one button (e.g. cross, circle, up, options). Optionally return a frame afterwards.

Hold several buttons together for duration_ms, then release them.

Deflect the left or right stick. x, y in -1..1 (left/up negative), then return to centre.

Pull L2 or R2 (side: left/right) to value 0..1, then release.

Click the touchpad. Coordinates are sent but not yet delivered by padd (touch mapping is unknown).

Run timed states in order, then release everything.

Each step: {"buttons": [...], "lx"/"ly"/"rx"/"ry": -1..1, "l2"/"r2": 0..1, "duration_ms": N}. A step with no inputs is a pause. Total duration is capped at 60 s.

Start recording every input (agent tools and the keyboard in the viewer) as timed steps.

Stop recording and save it under name (letters, digits, - and _).

Saved recordings with their length.

Replay a saved recording with its original timing (up to 5 minutes).

Save a region of the current frame (full 1920x1080 coordinates) as a template for wait_for.

Saved template names.

Wait until a saved template appears on screen (or disappears, with gone=true).

Matching is normalised cross-correlation over the whole frame; score 1.0 is identical. Returns where it was found, the score and the frame.

Release every button and centre the sticks (agent and keyboard).

Go to the PS5 home screen (stands in for the PS button, which the pad cannot send).

method: "suspend" (suspend the running game, as the PS button does), "system" or "shellcore". From system screens such as Settings, press circle instead.

Close the running game or app (unsaved progress is lost). The console returns to the home screen.

Launch an installed title by id (e.g. PPSA01325). list_apps() shows what is installed.

A game takes input only from the controller that launched it: launch it here to control it, because a game the user started with their own controller ignores this pad (and one launched here ignores theirs).

Installed title ids (from /user/app on the console).

DESTRUCTIVE: uninstall installed titles by id (e.g. ["PPSA01325"]); their data is deleted.

Only uninstall what the user asked for by name. For titles ShadowMountPlus manages, their source folder or image is deleted too (otherwise it installs them again). The console refuses while a game is running; close_app first. Removal finishes in the background after each request is accepted. Needs padd 1.3 or later.

Install a file from this Mac onto the console.

path: a .pkg package (uploaded through Web File Manager to /data/ps5-mcp/pkg, then installed; can take minutes) or an .elf payload (added to Payload Manager's library). run=True also starts the .elf once.

Wait until the screen changes (mean luma difference >= threshold on a 32x18 grid); returns the new frame.

Payload link, payload version and counters, capture state and frame age.

Open the live video window for a human (keyboard in that window drives the console too).