List the apps on this computer. Returns the set of apps that are currently running, as well as any that have been used in the last 14 days, including details on usage frequency

Start an app use session if needed, then get the state of the app's key window and return a screenshot and accessibility tree. This must be called once per assistant turn before interacting with the app

Click an element by index or pixel coordinates from screenshot

Invoke a secondary accessibility action exposed by an element

Set the value of a settable accessibility element

Select text inside a text element, or place the text cursor before or after it. Provide text exactly as it appears in the accessibility tree, including any Markdown formatting. If the text is not unique, provide surrounding prefix or suffix text to disambiguate it.

Scroll an element in a direction by a number of pages

Drag from one point to another using pixel coordinates

Press a key or key-combination on the keyboard, including modifier and navigation keys.

• This supports xdotool's key syntax.

• Examples: "a", "Return", "Tab", "super+c", "Up", "KP_0" (for the numpad 0 key).

Type literal text using keyboard input

Show direct-call architecture, durable no-permissions policy, signed broker status, supported methods, and private audit path.