Look through the camera
lookCapture a photo with the robot's front camera to identify sports balls, barrels, AIM robots, or AprilTags with bearings; use the ruler for other objects.
Instructions
Take a photo with the robot's front camera and see it yourself. Objects the robot's onboard AI recognises (sports balls, blue/orange barrels, AIM robots, AprilTags) are listed with their bearing. For anything else, read its bearing off the ruler along the top of the photo.
Tool call template
This tool declares no required parameters. Add optional parameters from the input schema as needed.
{
"id": 1,
"jsonrpc": "2.0",
"method": "tools/call",
"params": {
"arguments": {},
"name": "look"
}
}Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| overlay | No | Draw a bearing ruler and detection boxes on the photo | |
| yolo_detection | No | Also run YOLO on this computer to label 80 kinds of everyday object (person, cup, bottle, chair...). Takes a few seconds the first time. |