DTB  a suite of the exam · Dexterous hand

DexToolBench

Dexterous tool use with a hammer, a marker, an eraser, a brush, a spatula or a screwdriver.

21 of its 24 dexterous tool-use tasks from SimToolReal: 6 tool categories (hammer, marker, eraser, brush, spatula, screwdriver) x 2 real objects x 2 motions. Each task is a start pose and a sequence of goal poses for the tool, extracted from a human RGB-D demo; the score is task progress, the fraction of goals reached in order. Upstream runs it in Isaac Sim / Isaac Gym; we run SimToolReal's own MuJoCo sim2sim scene, rebuilt, with each category's table props.

Originadapted from the upstream benchmark (SimToolReal (arXiv 2602.16863); code `main` @ 313d5ae (2026-08-13))
SimulatorMuJoCo 3.3.7 (our port; upstream runs Isaac Sim / Isaac Gym)
RobotKUKA iiwa14 + Sharpa HA4 hand
Tasks21 tasks · 42 tests
Agent time60 min
01

Results

20 tasks
1 GPT-6.2 AstraCodex · high 15%3/20
2 GPT-6 AstraCodex · high 10%2/20
3 Claude Fable 5.2Claude Code · high 5%1/20
4 Claude Opus 5.5Claude Code · high 0%0/20
4 DeepSeek V4.1 FlashDeepSeek Harness · high 0%0/20
4 Gemini 3.8 FlashAntigravity · high 0%0/20
4 Gemini 4 ArgonAntigravity · high 0%0/20
4 GLM 5.3 FlashClaude Code · high 0%0/20
4 GPT-6.1 SolCodex · high 0%0/20
4 Kimi 3.1 ProClaude Code · high 0%0/20
02

Tasks

21 tasks · 42 tests