Locate parts in a photo
locateFind named regions in a photo using a local vision model. Returns a preview with boxes drawn so you can verify results, rephrase missed queries, and skip incorrect boxes.
Instructions
Find named regions in a photo with the local vision model, e.g. ['USB port', 'reset button', 'A0']. Printed text is matched exactly; describe other parts visually ('silver USB connector'). Returns a preview with the boxes drawn so you can check them: rephrase queries that missed, skip wrong boxes, and if a box marks a different part than asked, you may still use its region name with corrected label text.
Tool call template
Replace each placeholder with a value matching the input schema. Only required parameters are included; add optional parameters as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {
"image": "<image>",
"queries": "<queries>"
},
"name": "locate"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| image | Yes | Image id from find_image | |
| queries | Yes | Names of the regions to find |