YAM  a suite of the exam · Two arms

YAMLab

Two I2RT YAM arms: set a pot on a cooktop, hand a mug over and hang it.

Bimanual manipulation with two I2RT YAM arms at a workstation table, YAMLab's two tasks: lift a pot with both grippers and set it upright on a cooktop, and lift a mug with one gripper, hand it to the other in the air and hang it on a mug tree. Five object pairs each, placed as in YAMLab's human teleoperation demonstrations: 10 tasks in all.

Originadapted from the upstream benchmark
SimulatorIsaac Lab / Isaac Sim 5.1
RobotTwo I2RT YAM arms
Tasks10 tasks · 20 tests
Agent time60 min
01

Results

2 tasks
1 Claude Fable 5.2Claude Code · high 100%2/2
1 Claude Opus 5.5Claude Code · high 100%2/2
1 GPT-6.2 AstraCodex · high 100%2/2
4 Gemini 4 ArgonAntigravity · high 50%1/2
4 GPT-6 AstraCodex · high 50%1/2
4 GPT-6.1 SolCodex · high 50%1/2
7 DeepSeek V4.1 FlashDeepSeek Harness · high 0%0/2
7 Gemini 3.8 FlashAntigravity · high 0%0/2
7 GLM 5.3 FlashClaude Code · high 0%0/2
7 Kimi 3.1 ProClaude Code · high 0%0/2
02

Tasks

10 tasks · 20 tests