Capture the desktop and return it as an image.

Take one before acting, and after any action whose result you need to see. All other tools expect coordinates measured on this image.

Click at (x, y), in screenshot-image coordinates.

button: "left", "right" or "middle". count: 2 for a double-click.

Move the pointer to (x, y) without clicking -- useful for hover states.

Press at one point, move, and release at another.

Use for selecting text, moving windows, and dragging sliders.

Scroll under the pointer at (x, y).

dy is in wheel detents: negative scrolls down the page, positive scrolls up.

Type text into whatever currently has keyboard focus.

Click the target field first. Newlines in the text are typed as Enter.

Press a key or chord, e.g. "enter", "ctrl+s", "alt+tab", "cmd+space".

Modifiers: ctrl, alt, shift, super (aka win), cmd. "cmd" is Command on macOS and Super elsewhere, so one chord works across platforms.

Report where the pointer is, in both image and screen coordinates.

List open windows with their titles and geometry, where the OS allows it.

Pause, then look again. Use while a page loads or an animation finishes.

Report the environment, the chosen backends, and the active safety limits.

Worth calling once at the start of a session, or whenever something fails.