ghost_query
Extract structured screen data using UI name-matching, then a batched VLM call for unmatched fields. Returns extracted values, unmatched list, and whether VLM was attempted.
Instructions
Extract structured data from the screen. Strategy: UIA name-matching first, then a single batched VLM call for any fields still unmatched. Returns extracted object, unmatched list, and vlm_attempted flag.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| region | No | Optional [left,top,right,bottom] region for VLM screenshot crop | |
| schema | No | JSON Schema (properties map) or array of field names to extract | |
| window | No | Scope to window (partial title) |