RGR1  a suite of the exam · Humanoid

RoboCasa-GR1

A Fourier GR1 humanoid with dexterous hands, picking and placing at a counter.

A Fourier GR1 humanoid with two dexterous hands at a kitchen counter: picking objects from one container or surface and placing them in another, including novel objects, and placing into a cabinet, drawer or microwave and closing it. We keep all 24 environments with an official demonstration, one frozen instance each (the demonstration's initial state). Each task passes or fails on the environment's own success checker on the state after the last action, with no partial credit, and runs in two modes: unlimited (privileged: full simulator state, unlimited resets, one replayable trajectory handed in) and limited (standard: the humanoid's own six cameras, one episode, no reset).

Originadapted from the upstream benchmark (RoboCasa GR1 tabletop tasks @ 4840e67, all 24 (exam @ 8c5594a43))
Simulatorrobosuite @ 51cc017 (1.5.1, mink whole-body IK) / MuJoCo 3.2.6 (RoboCasa GR1 tabletop)
RobotFourier GR1
Tasks24 tasks · 48 tests
Agent time60 min
01

Results

1 task
1 Claude Fable 5.2Claude Code · high 100%1/1
1 Claude Opus 5.5Claude Code · high 100%1/1
1 GPT-6.2 AstraCodex · high 100%1/1
4 DeepSeek V4.1 FlashDeepSeek Harness · high 0%0/1
4 Gemini 3.8 FlashAntigravity · high 0%0/1
4 Gemini 4 ArgonAntigravity · high 0%0/1
4 GLM 5.3 FlashClaude Code · high 0%0/1
4 GPT-6 AstraCodex · high 0%0/1
4 GPT-6.1 SolCodex · high 0%0/1
4 Kimi 3.1 ProClaude Code · high 0%0/1
02

Tasks

24 tasks · 48 tests