LBU  a suite of the exam · One arm

LabUtopia

A chemistry laboratory: glassware, a heater, an instrument panel, an oven and drawers.

Nine LabUtopia tasks in a chemistry laboratory for a Franka Panda: pick, place, pour and shake glassware, heat a liquid, press an instrument's buttons, open and close a drying oven's door and a cabinet's drawers.

Originadapted from the upstream benchmark
SimulatorIsaac Sim 6.1
RobotFranka Panda
Tasks9 tasks · 18 tests
Agent time60 min
01

Results

Different models were evaluated on different tasks, so the results are not fully comparable.

9 tasks
· GPT-6 LunaCodex · xhigh 100%9/9
02

Tasks

9 tasks · 18 tests