ARC  a suite of the exam · Two arms and one arm

RoboARCEFE Original

Tests manipulation of tangled, deformable and multi-part objects. Robot arms take apart metal wire puzzles, tie and thread ropes, fold cloth and assemble IKEA furniture.

Physical puzzles for the two arms of an ALOHA 2 or a Franka arm with a Robotiq gripper: separate interlocked claws, take a ring off a horseshoe or a slotted post, free a hedgehog from its cage, fit two cast-puzzle pieces together, turn a key through a lock, guide a loop along a buzz wire without touching it, untie a knot, thread a rope or a fiber bundle through rings, flatten or fold a blanket. With them, IKEA furniture builds for two arms that hold the parts by finger friction alone: screw the legs into a LACK table, fit the dowels and panels of an EKET cabinet, close the snaps of a VESKEN shelf, drive bolts with a hex key. The simulator judges the end state (the piece in its goal region, the rope free of crossings, every part seated and at rest after the robot lets go), and a success won by pushing parts deep into each other is held for review rather than credited. The hard part is working out the shape of the puzzle before touching it, then handling ropes, cloth and tight fits with a gripper.

EFE Original
Originbuilt by the exam’s team, released with the exam
SimulatorMuJoCo 3.14 (CPU float64; the cloth on a deterministic GPU solver); videos rendered with Blender Cycles
RobotALOHA 2, Two Franka Panda arms, Franka + Robotiq 2F-85
Tasks106 tasks · 212 tests
Agent time180 min
01

Results

58 tasks
1 Claude Fable 5.2Claude Code · high 57%33/58
2 GPT-6.2 AstraCodex · high 55%32/58
3 Claude Opus 5.5Claude Code · high 26%15/58
4 GPT-6 AstraCodex · high 24%14/58
4 GPT-6.1 SolCodex · high 24%14/58
6 Gemini 4 ArgonAntigravity · high 10%6/58
7 Gemini 3.8 FlashAntigravity · high 3%2/58
8 DeepSeek V4.1 FlashDeepSeek Harness · high 0%0/58
8 GLM 5.3 FlashClaude Code · high 0%0/58
8 Kimi 3.1 ProClaude Code · high 0%0/58
02

Tasks

106 tasks · 212 tests