dense_region_caption
Automatically discover and caption every salient region in an image, returning bounding boxes and labels per detected object, so you can inventory an image's contents without preselecting categories.
Instructions
Caption every salient region of an image at once, with bounding boxes.
Use this to inventory an image without knowing in advance what is in it --
it returns bboxes and labels for each region it finds, discovering the
objects itself. That is the difference from detect_objects, which needs
you to name the object you are looking for, and from caption, which
describes the whole scene in prose with no coordinates.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| src | Yes | Local file path or http(s) URL of the image to process. PDFs are also accepted and are rendered one image per page, so tools that return a list return one entry per page. |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |