MW+ a suite of the exam · One arm
MetaWorld+
All 50 Meta-World v3 environments for a Sawyer arm, one frozen instance each.
All 50 of Meta-World's v3 environments for a Sawyer arm (reward v2), one frozen instance each: push, pick and place, open doors, drawers and windows, press buttons, turn dials and faucets, insert pegs, hammer, sweep and more. Each task passes or fails on Meta-World's own success checker on the state after the agent's last action, with no partial credit, and runs in two modes: unlimited (privileged: full simulator state, unlimited resets, one replayable trajectory of at most 500 actions handed in) and limited (standard: a robot behind a service, four fixed cameras and the arm's own state, one episode, no reset). Privileged is reported as a control; the standard mode is the benchmark.
| Origin | adapted from the upstream benchmark (our benchmark (exam @ 8c5594a43): Meta-World v3 @ 59fc34d, all 50 environments) |
|---|---|
| Simulator | MuJoCo 3.3.0 (Meta-World v3) |
| Robot | Rethink Sawyer |
| Tasks | 50 tasks · 100 tests |
| Agent time | 30 min |
On a real robot
Tasks
50 tasks · 100 tests