Detect Fashion Pieces & Bounding Boxes
vision.outfit.detect_piecesDeconstruct an outfit photo into individual fashion pieces with bounding boxes and confidence scores. Use this tool to segment a full look into garments before searching for matching products.
Instructions
Deconstruct an outfit image or influencer photo into individual fashion pieces (e.g. Upper-body garment, Lower-body garment, Dress, Footwear, Bag, Headwear) with normalized bounding box coordinates and detection confidence scores.
PURPOSE & DISAMBIGUATION:
Computer-vision object detection tool designed to analyze multi-item outfit photographs and isolate individual garments with their spatial coordinates.
Distinct from 'products.search.image_url' / 'products.search.image_upload': Use this tool to segment a full outfit into pieces before querying, NOT to directly retrieve catalog search results.
Distinct from 'looks.curation.recommend': Use this tool for image-based piece decomposition, NOT text-based styling suggestions.
WHEN TO USE:
When the user provides a full-body model photo, street style snapshot, or celebrity outfit and wants to identify each individual clothing piece (jacket, top, pants, shoes, bag) to find matching products for each piece.
WHEN NOT TO USE:
Do NOT use when the image contains only a single standalone garment (use 'products.search.image_url' or 'products.search.image_upload' directly).
Do NOT use for text-only searches (use 'products.search.text').
BEHAVIOR & SAFETY:
Read-only and idempotent with no persistent state modifications.
Supports input via local file path ('image_path'), base64 string ('image_base64'), or public URL ('image_url'). Exactly one source must be provided.
Returns an array of detected piece objects with 'label', 'confidence' (0.0 to 1.0), and normalized 'box' coordinates [ymin, xmin, ymax, xmax].
PARAMETERS & CONSTRAINTS:
'image_path' (string, optional): Local file system path to the outfit image (e.g. '/tmp/outfit.jpg').
'image_base64' (string, optional): Base64-encoded image data string.
'image_url' (string, optional): Public HTTP(S) URL of the image.
'threshold' (number 0.05-0.95, default 0.22): Detection confidence threshold for bounding box filtering.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| image_url | No | Public HTTP(S) URL of the fashion image to deconstruct | |
| threshold | No | Confidence threshold for object detection bounding boxes (0.05 to 0.95, default 0.22) | |
| image_path | No | Local file system path to the outfit image file to deconstruct | |
| image_base64 | No | Base64-encoded image data string for outfit piece detection |