observe
Read a macOS app's window as a one-line-per-element outline with action refs; later calls return only changes, and focus opens a folded part.
Instructions
Outline of an app's window: one line per element, each with a ref like b3 or t1 for act. Later calls return only what changed. Long parts are folded; pass focus to open one. In apps that draw their own interface, labels read from the pixels appear as seen (v refs): click or drag them.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"app": "<app>"
},
"name": "observe"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| app | Yes | App name, bundle id or pid | |
| full | No | The whole outline instead of changes | |
| focus | No | A ref: show only this part, unfolded | |
| menus | No | Instead: every menu command with its shortcut | |
| window | No | Part of a window title (default: main window) |