RWT a suite of the exam · Two arms
RoboWits
Tabletop tasks that need a physical insight, like a ruler to align things or a funnel to pour.
15 of its 30 seed tabletop tasks for a fixed bimanual robot, each requiring a physical insight rather than a longer motion: use a ruler to align, a dustpan to sweep, a funnel to pour, an inclined plane to move a box. 163 published mutations vary the scene while keeping the parent task's success predicate. Scored by the task's own success checker.
| Origin | adapted from the upstream benchmark (code release 2026-06-04 (commit 9cc30ae)) |
|---|---|
| Simulator | Genesis 0.4.7 (gs_gym) |
| Robot | Marvin |
| Tasks | 15 tasks · 30 tests |
| Agent time | 60 min |
On a real robot
6 tasks
1
Claude Opus 5.5Claude Code · high
50%3/6
1
GPT-6.1 SolCodex · high
50%3/6
1
GPT-6.2 AstraCodex · high
50%3/6
4
Claude Fable 5.2Claude Code · high
33%2/6
4
Gemini 4 ArgonAntigravity · high
33%2/6
4
GPT-6 AstraCodex · high
33%2/6
4
Kimi 3.1 ProClaude Code · high
33%2/6
8
DeepSeek V4.1 FlashDeepSeek Harness · high
0%0/6
8
Gemini 3.8 FlashAntigravity · high
0%0/6
8
GLM 5.3 FlashClaude Code · high
0%0/6
02
Tasks
15 tasks · 30 tests