ABO a suite of the exam · One arm and two arms
AutoBio
A biology bench: thermal cycler, mixer, centrifuge, screw caps and a pipette.
Nine AutoBio tasks on a biology laboratory bench: a thermal cycler with a lid and a locking lever, a thermal mixer with a working button panel, a centrifuge with a 30-slot rotor, tubes with real screw threads and a pipette, for UR5e arms with a Robotiq gripper, ALOHA arms, and a UR5e pair of which one holds the pipette in a dexterous hand.
| Origin | adapted from the upstream benchmark |
|---|---|
| Simulator | MuJoCo 3.3 (CPU) |
| Robot | ALOHA 2, One ALOHA 2 arm, Two UR5e arms (dexterous hand + Robotiq), UR5e + Robotiq 2F-85 |
| Tasks | 9 tasks · 18 tests |
| Agent time | 60 min |
On a real robot
Different models were evaluated on different tasks, so the results are not fully comparable.
9 tasks
·
Claude Opus 5.5Claude Code · high
100%1/1
·
Gemini 3.8 FlashAntigravity · high
100%1/1
·
GPT-6 AstraCodex · high
100%1/1
·
GPT-6 LunaCodex · xhigh
33%3/9
·
DeepSeek V4.1 FlashDeepSeek Harness · high
0%0/1
·
GLM 5.3 FlashClaude Code · high
0%0/1
02
Tasks
9 tasks · 18 tests