owa_find_ui
Locate a UI control by visible text or tooltip, report its screen location and panel, then optionally highlight it or search all open windows.
Instructions
Find a control in the app by its visible text or tooltip, and say where it is on screen (plus which component renders it, in dev). Matching is tolerant -- exact words first, then looser fits -- and a zero answer comes back with the closest labels that ARE on screen, so retry with one of those instead of a new guess. Write "Panel > Control" when the same words appear in more than one panel ("Background > Videos"), and say "the X panel" to mean the panel itself; each answer names the panel it is in. highlight outlines it in the real window for four seconds, so the user can be pointed at it. anyPage searches every open window and says which one each match lives in. A match marked showsOnHover is one the app only paints while the mouse is over that part of the window, so tell the user to move the mouse there; highlight holds it up meanwhile.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"text": "<text>"
},
"name": "owa_find_ui"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| page | No | Part of the window URL, e.g. "reader.html"; default the main window. | |
| text | Yes | ||
| anyPage | No | Search every open window, not just one, and tag each match with the window it is in. Use when the control could be in either half of the app. | |
| highlight | No |