get_app_state
Retrieve a target app's or window's screenshot, accessibility tree, and UI hints before running actions to locate elements by index or coordinates.
Instructions
Get a target app/window screenshot, accessibility tree, and uiHints. Call this before action tools, then use element_index or screenshot/window-relative coordinates. uiHints separates AT-SPI menu entries from tab/ribbon/toolbar controls; do not substitute a same-named menu for a requested tab.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"app": "<app>"
},
"name": "get_app_state"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| app | Yes | App name, Hyprland class/title, pid, or address:0x... selector. |