resolve_elements
Finds UI elements by walking the uia → cdp → vision backend chain and returns the first non-empty element set, the tier that answered, and why earlier tiers fell through. Read-only.
Instructions
Walk the structured-first backend chain (uia -> cdp -> vision) and return the first non-empty element set, which tier answered, and why the earlier tiers fell through. Read-only.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "resolve_elements"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| hwnd | No | native window handle; enables the uia tier | |
| port | No | CDP port; 0 skips the cdp tier | |
| origin_x | No | window top-left inside the image, X; subtracted to reach window-relative coords | |
| origin_y | No | window top-left inside the image, Y; subtracted to reach window-relative coords | |
| max_results | No | ||
| url_contains | No | ||
| detections_path | No | screen-parsing detection JSON; enables the vision tier |