Take one of the user's apps for a demo, with the REAL mouse and keyboard while the user watches: brings its window to the front (maximised unless maximize=false) and returns what can be acted on (refs, roles, names, boxes in pixels from the window's top-left) with a screenshot. From now on screen_look, screen_act and screen_record_* work on this app. If the user moves the mouse, you are stopped.

response_detail (summary|compact|full), fields (dotted paths), cursor (next page) — see the server instructions.