Leaderboard for agentic robotics

Leaderboard

AnalysisWhere do today’s agentic robots succeed and fail? Read the analysis→

481 core tasks. A task counts as solved only if the agent solved every mode it has (standard, and privileged or realtime where the task has them).

481 tasks

Suite by suite · Standard

SR % · solved / testedGPT-6.2 AstraClaude Fable 5.2GPT-6 AstraGPT-6.1 SolClaude Opus 5.5Gemini 4 ArgonKimi 3.1 ProGemini 3.8 FlashDeepSeek V4.1 FlashGLM 5.3 Flash
EFE Suites
DXHDexHandExam23 tasks 87%20/2365%15/2357%13/2339%9/239%2/2317%4/239%2/234%1/230%0/230%0/23
OLFEmbodied Olympics - Fun56 tasks 41%23/5645%25/5636%20/5634%19/5623%13/5614%8/5611%6/562%1/564%2/560%0/56
OLMEmbodied Olympics - Match13 tasks 54%7/1338%5/1323%3/1331%4/130%0/1323%3/1315%2/130%0/130%0/138%1/13
ESEEmbodied Safety Exam50 tasks 52%26/5068%34/5062%31/5058%29/5038%19/5054%27/5018%9/5020%10/504%2/5010%5/50
ISGiSpatialGym8 tasks 88%7/875%6/850%4/850%4/838%3/825%2/813%1/813%1/80%0/80%0/8
ARCRoboARC58 tasks 55%32/5857%33/5824%14/5824%14/5826%15/5810%6/580%0/583%2/580%0/580%0/58
PDSRoboDynamicExam10 tasks 30%3/1030%3/1010%1/100%0/1010%1/100%0/100%0/100%0/100%0/100%0/10
ENGRoboEngineer15 tasks 20%3/1547%7/1533%5/1520%3/1527%4/1527%4/1513%2/150%0/1513%2/1513%2/15
RPTRoboPaint22 tasks 95%21/229%2/2232%7/2227%6/225%1/225%1/220%0/220%0/220%0/220%0/22
Existing Suites
AMBAM-Bench2 tasks 50%1/2100%2/2100%2/2100%2/250%1/20%0/2100%2/2100%2/2100%2/20%0/2
B1KBEHAVIOR-1K71 tasks 54%38/7127%19/7115%11/7114%10/716%4/714%3/710%0/710%0/710%0/710%0/71
BG2BiGym 2.010 tasks 10%1/1010%1/1010%1/100%0/100%0/100%0/100%0/100%0/100%0/100%0/10
DXJDexJoCo2 tasks 100%2/2100%2/250%1/20%0/2100%2/250%1/20%0/250%1/20%0/20%0/2
DTBDexToolBench20 tasks 15%3/205%1/2010%2/200%0/200%0/200%0/200%0/200%0/200%0/200%0/20
ESWEmbodiedSWE12 tasks 67%8/1267%8/1242%5/1242%5/1242%5/1233%4/120%0/1217%2/120%0/120%0/12
HBHumanoidBench8 tasks 0%0/80%0/813%1/80%0/80%0/80%0/80%0/80%0/80%0/80%0/8
KNDKinDER4 tasks 50%2/425%1/40%0/425%1/40%0/40%0/40%0/40%0/40%0/40%0/4
LBXLIBERO-MAX2 tasks 100%2/2100%2/2100%2/2100%2/2100%2/2100%2/250%1/250%1/20%0/20%0/2
MGDManiGuard7 tasks 57%4/786%6/743%3/771%5/7100%7/757%4/743%3/70%0/70%0/70%0/7
MW+MetaWorld+2 tasks 100%2/2100%2/250%1/2100%2/2100%2/2100%2/2100%2/250%1/250%1/250%1/2
MOLMolmoSpaces2 tasks 100%2/2100%2/2100%2/2100%2/2100%2/2100%2/250%1/20%0/250%1/250%1/2
MJPMuJoCo Playground7 tasks 100%7/743%3/757%4/743%3/70%0/729%2/70%0/70%0/70%0/70%0/7
MYOMyoSuite13 tasks 54%7/1338%5/1323%3/1323%3/1323%3/130%0/130%0/130%0/130%0/130%0/13
RCARoboCasa2 tasks 100%2/2100%2/20%0/2100%2/2100%2/250%1/2100%2/20%0/250%1/20%0/2
RGR1RoboCasa-GR11 task 100%1/1100%1/10%0/10%0/1100%1/10%0/10%0/10%0/10%0/10%0/1
R365RoboCasa3655 tasks 60%3/540%2/520%1/520%1/50%0/50%0/50%0/50%0/50%0/50%0/5
RDJRoboDojo37 tasks 59%22/3776%28/3757%21/3743%16/3749%18/3746%17/3724%9/375%2/378%3/373%1/37
RLBRoboLab6 tasks 33%2/633%2/60%0/633%2/617%1/60%0/60%0/617%1/60%0/60%0/6
RTWRoboTwin 2.03 tasks 100%3/333%1/333%1/367%2/3100%3/333%1/30%0/30%0/30%0/30%0/3
RWTRoboWits6 tasks 50%3/633%2/633%2/650%3/650%3/633%2/633%2/60%0/60%0/60%0/6
VLBVLABench2 tasks 50%1/250%1/20%0/250%1/250%1/20%0/20%0/20%0/20%0/20%0/2
YAMYAMLab2 tasks 100%2/2100%2/250%1/250%1/2100%2/250%1/20%0/20%0/20%0/20%0/2
All suites481 tasks 54%260/48147%225/48134%162/48131%151/48124%117/48120%97/4819%44/4815%25/4813%14/4812%11/481