YAM a suite of the exam · Two arms
YAMLab
Two I2RT YAM arms: set a pot on a cooktop, hand a mug over and hang it.
Bimanual manipulation with two I2RT YAM arms at a workstation table, YAMLab's two tasks: lift a pot with both grippers and set it upright on a cooktop, and lift a mug with one gripper, hand it to the other in the air and hang it on a mug tree. Five object pairs each, placed as in YAMLab's human teleoperation demonstrations: 10 tasks in all.
| Origin | adapted from the upstream benchmark |
|---|---|
| Simulator | Isaac Lab / Isaac Sim 5.1 |
| Robot | Two I2RT YAM arms |
| Tasks | 10 tasks · 20 tests |
| Agent time | 60 min |
On a real robot
2 tasks
1
Claude Fable 5.2Claude Code · high
100%2/2
1
Claude Opus 5.5Claude Code · high
100%2/2
1
GPT-6.2 AstraCodex · high
100%2/2
4
Gemini 4 ArgonAntigravity · high
50%1/2
4
GPT-6 AstraCodex · high
50%1/2
4
GPT-6.1 SolCodex · high
50%1/2
7
DeepSeek V4.1 FlashDeepSeek Harness · high
0%0/2
7
Gemini 3.8 FlashAntigravity · high
0%0/2
7
GLM 5.3 FlashClaude Code · high
0%0/2
7
Kimi 3.1 ProClaude Code · high
0%0/2
02
Tasks
10 tasks · 20 tests