LBU a suite of the exam · One arm
LabUtopia
A chemistry laboratory: glassware, a heater, an instrument panel, an oven and drawers.
Nine LabUtopia tasks in a chemistry laboratory for a Franka Panda: pick, place, pour and shake glassware, heat a liquid, press an instrument's buttons, open and close a drying oven's door and a cabinet's drawers.
| Origin | adapted from the upstream benchmark |
|---|---|
| Simulator | Isaac Sim 6.1 |
| Robot | Franka Panda |
| Tasks | 9 tasks · 18 tests |
| Agent time | 60 min |
On a real robot
Different models were evaluated on different tasks, so the results are not fully comparable.
9 tasks
·
GPT-6 LunaCodex · xhigh
100%9/9
02
Tasks
9 tasks · 18 tests