R365  a suite of the exam · Mobile robot

RoboCasa365

Atomic and long composite kitchen activities from RoboCasa's 365-task suite.

RoboCasa's 365-task kitchen suite for the same mobile manipulator: atomic skills and long composite activities across cooking, cleaning, storing and serving. We keep 50 of the families with a validated demonstration, chosen by a fixed rule (12 atomic, 38 composite, in SHA-256 order of their names), one frozen instance each. Each task passes or fails on the environment's own success checker on the state after the last action, with no partial credit, and runs in two modes: unlimited (privileged: full simulator state, unlimited resets, one replayable trajectory handed in) and limited (standard: the robot's own four cameras, one episode, no reset).

Originadapted from the upstream benchmark (RoboCasa365 (robocasa 1.0.1 @ 4f8a298), our selection of 50 tasks (exam @ 8c5594a43))
Simulatorrobosuite 1.5.2 / MuJoCo 3.3.1 (RoboCasa365)
RobotFranka Panda on an Omron base
Tasks50 tasks · 101 tests
Agent time60 min
01

Results

5 tasks
1 GPT-6.2 AstraCodex · high 60%3/5
2 Claude Fable 5.2Claude Code · high 40%2/5
3 GPT-6 AstraCodex · high 20%1/5
3 GPT-6.1 SolCodex · high 20%1/5
5 Claude Opus 5.5Claude Code · high 0%0/5
5 DeepSeek V4.1 FlashDeepSeek Harness · high 0%0/5
5 Gemini 3.8 FlashAntigravity · high 0%0/5
5 Gemini 4 ArgonAntigravity · high 0%0/5
5 GLM 5.3 FlashClaude Code · high 0%0/5
5 Kimi 3.1 ProClaude Code · high 0%0/5
02

Tasks

50 tasks · 101 tests