ISG a suite of the exam · Mobile robot
iSpatialGym✦EFE Original
Tests spatial reasoning from images. The goal is given only as a picture: a mobile two-armed robot rearranges the room, or moves itself, until its camera view matches it.
Spatial reasoning for a mobile two-armed robot, a Galaxea R1 Pro, in BEHAVIOR-1K's houses. Each task gives only a goal image, the head camera's view once the task is done, and no sentence names the objects: line an object up with a table edge, set a tilted one upright, place it in, on, under, next to or touching another, open an appliance to the pictured angle, arrange blocks into a pattern, turn a held object to the pictured orientation, or drive and move until its own camera sees the goal view. Success is a geometric check: every measured target within tolerance, with the objects and the robot at rest over the last moments of the episode. No reference solution ships with these tasks.
| Origin | built by the exam’s team, released with the exam |
|---|---|
| Simulator | OmniGibson (BEHAVIOR-1K fork) on Isaac Sim 5.1 |
| Robot | Galaxea R1 Pro |
| Tasks | 12 tasks · 24 tests |
| Agent time | 60 min |
On a real robot
Tasks
12 tasks · 24 tests