computer.find_visual
Locate UI elements on screen using image templates or natural-language descriptions. Returns a bounding box for precise interaction.
Instructions
Find a UI element visually: by image template name (from the configured template directory) or by natural-language description via the optional vision model. Returns a bounding box.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "computer.find_visual"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| template | No | ||
| threshold | No | ||
| description | No |