Observe the live world and build semantic entity handles
observe-worldCapture a bounded, read-only snapshot of the Roblox game world, fusing character, camera, GUI, nearby parts, interactables, and tools into actionable evidence and handles.
Instructions
Perform one bounded, read-only Luau observation that fuses the active or custom character rig, current camera, visible PlayerGui objects, nearby 3D parts, ClickDetectors, ProximityPrompts, TouchTransmitters, and Tool instances in the Backpack or character. It returns compact evidence, exact GetFullName paths plus executable bracket-safe Luau expressions, screen position and distance where available, exact scanned/truncation counts, and stable session-local handles. Handles are retained in getgenv().__mcp_world_brain using weak references when supported and structural fingerprints for later resolve-entity calls. The walk uses GetChildren with hard instance/result caps; it never starts frame loops or performs an unbounded GetDescendants scan. Signature: { radius: any?, roots: any?, features: any?, maxInstances: any?, maxResults: any?, threadContext: number? }. Phase: observe; cost=medium; idempotency=read-only. Requires: active-client. Produces: grounded-evidence, bounded-world-model, semantic-entity-handles, actionable-instance-expressions, custom-character-resolution, camera-state, visible-gui, nearby-3d-entities, interaction-targets, inventory-tools. Verify with: resolve-entity. Safety: read-only. On failure: inspect tool-schema for exact fields, defaults, constraints, and an invocation example.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| roots | No | Bounded traversal roots. Omit a root to avoid scanning that domain; custom rigs generally require workspace. | |
| radius | No | Maximum distance in studs for nearby 3D objects and interactables. Distance uses the resolved character root, then the character pivot, then the camera position. | |
| features | No | Observation features to include. Character and camera probes are cheap; GUI, nearby, interactables, and tools are collected only from the selected bounded roots. | |
| maxResults | No | Maximum ranked semantic entities returned. Exact candidate counts and result truncation are still reported. | |
| maxInstances | No | Hard maximum number of unique Instances examined across all selected roots. | |
| threadContext | No | Optional Roblox thread identity for this call; omit it to use the server default. |