apps_interface_input
Send clicks, drags, scrolls, ASCII text, and key chords to an active device or preview App interface; press Guide Start to begin an app, then verify results via screenshots.
Instructions
Click, drag, scroll, type English/ASCII text or send a key/chord in the active device App interface. Use event type guide_start to press the current App Guide Start on an explicit preview/device target; it does not approve access or I/O. Other host menus and permission dialogs remain human-operated. Read apps_input_targets first; pointer coordinates are normalized App coordinates, scroll deltas are CSS pixels. Delivery confirms sent/dispatched events; use screenshots/App state to verify the intended result.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| event | Yes | type: guide_start/click/drag/scroll/text/key. guide_start has no coordinates and only presses the current first-open Guide Start. Pointer x,y and drag toX,toY: 0..1. Scroll deltaX,deltaY: -2000..2000. Text: ASCII, max2048. Key: Enter/Tab/Backspace/Delete/arrows/Home/End/Escape or one ASCII character; ctrlKey/altKey/shiftKey/metaKey booleans. | |
| target | No | Default device; preview supports guide_start only. | |
| generation | Yes | ||
| instanceId | Yes |