spatial_infer_screenshot_scene_graph
Convert screenshot detections into a spatial scene graph by inferring object relationships and positions, producing reconstruction-ready handoffs.
Instructions
Infer a clean-room spatial scene graph from screenshot detections.
KB: see knowledge_base/10_WORLD_BUILDING.md#9-world-building-best-practices
This local planner does not perform image segmentation. It consumes agent/vision-supplied detected_items_json, uses crop positions and prop metadata to infer relationships such as left/right, foreground, support contact, wall anchors, and zone clusters, then emits richer reconstruction handoffs.
Example: spatial_infer_screenshot_scene_graph(reference_image="C:/refs/apartment.png", detected_items_json="", image_size=[1280, 720])
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| limit | No | ||
| room_type | No | apartment | |
| image_size | No | ||
| reference_image | Yes | ||
| detected_items_json | Yes | ||
| include_reconstruction_handoff | No |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
| result | Yes |