Find scenes by description
search_scenes_semanticFind scenes by describing what they show, like 'a dog running on a beach', without needing tags. Alternatively, rank scenes by visual similarity to a thumbnail id.
Instructions
Find scenes by describing what is in the picture - 'a dog running on a beach', 'close-up of hands typing', 'city skyline at night'. Nothing has to be tagged: every indexed scene is ranked by how well it matches the words, so use this when the keywords search_scenes needs do not cover what you are after, and use similarTo to find footage that looks like a scene you already have (the source scene itself is left out of those results). Results come best first, each with the thumbnail id, the video, the time (seconds and hh:mm:ss) and a relevance score. Judge by the order, not the number: for a description a good match scores only about 0.15-0.30, while scenes that look like a given one score 0.8 and above, and scores are comparable only within one search. Pass a thumbnail id to get_scene_image to check what a scene really shows. If the answer says the model or the index is missing, tell the user what to do; do not retry.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | How many of the best matches to return. Defaults to 20, maximum 200. | |
| query | No | What the scene should show, in plain words. Ignored when similarTo is given. | |
| videoId | No | Restrict the search to one video by its id. | |
| similarTo | No | A thumbnail id: rank scenes by how much they look like this one instead of by a description. |