PDS  a suite of the exam · Two arms and one arm

RoboDynamicExamEFE Original

Tests handling of moving objects. One or two robot arms catch, strike, carry and hand over objects in motion: tossed balls, sliding pucks, swinging loads.

Multi-stage dynamic manipulation for one or two Franka Panda arms, most of them holding a rigid tool such as a plate, a cup, a paddle or a scoop. In every task something moves by itself (a tossed ball, a sliding puck, a conveyor, a pendulum, a spring gate, a moving cart), and the robot has to catch, strike, carry, flip, hand over or release at the right moment, several times in an episode of under a minute of simulated time. Success is every phase of the task in order with no failure on the way, checked from the simulator state, so a ball dropped in the third phase fails the whole task. Most tasks also run in real time, where the world keeps moving while the agent thinks.

EFE Original
Originbuilt by the exam’s team, released with the exam
SimulatorManiSkill 3 / SAPIEN (CPU PhysX at 1000 Hz)
RobotFranka Panda, Two Franka Panda arms
Tasks25 tasks · 69 tests
Agent time60 min
01

Results

10 tasks
1 Claude Fable 5.2Claude Code · high 30%3/10
1 GPT-6.2 AstraCodex · high 30%3/10
3 Claude Opus 5.5Claude Code · high 10%1/10
3 GPT-6 AstraCodex · high 10%1/10
5 DeepSeek V4.1 FlashDeepSeek Harness · high 0%0/10
5 Gemini 3.8 FlashAntigravity · high 0%0/10
5 Gemini 4 ArgonAntigravity · high 0%0/10
5 GLM 5.3 FlashClaude Code · high 0%0/10
5 GPT-6.1 SolCodex · high 0%0/10
5 Kimi 3.1 ProClaude Code · high 0%0/10
02

Tasks

25 tasks · 69 tests