RWT  a suite of the exam · Two arms

RoboWits

Tabletop tasks that need a physical insight, like a ruler to align things or a funnel to pour.

15 of its 30 seed tabletop tasks for a fixed bimanual robot, each requiring a physical insight rather than a longer motion: use a ruler to align, a dustpan to sweep, a funnel to pour, an inclined plane to move a box. 163 published mutations vary the scene while keeping the parent task's success predicate. Scored by the task's own success checker.

Originadapted from the upstream benchmark (code release 2026-06-04 (commit 9cc30ae))
SimulatorGenesis 0.4.7 (gs_gym)
RobotMarvin
Tasks15 tasks · 30 tests
Agent time60 min
01

Results

6 tasks
1 Claude Opus 5.5Claude Code · high 50%3/6
1 GPT-6.1 SolCodex · high 50%3/6
1 GPT-6.2 AstraCodex · high 50%3/6
4 Claude Fable 5.2Claude Code · high 33%2/6
4 Gemini 4 ArgonAntigravity · high 33%2/6
4 GPT-6 AstraCodex · high 33%2/6
4 Kimi 3.1 ProClaude Code · high 33%2/6
8 DeepSeek V4.1 FlashDeepSeek Harness · high 0%0/6
8 Gemini 3.8 FlashAntigravity · high 0%0/6
8 GLM 5.3 FlashClaude Code · high 0%0/6
02

Tasks

15 tasks · 30 tests