DTB a suite of the exam · Dexterous hand
DexToolBench
Dexterous tool use with a hammer, a marker, an eraser, a brush, a spatula or a screwdriver.
21 of its 24 dexterous tool-use tasks from SimToolReal: 6 tool categories (hammer, marker, eraser, brush, spatula, screwdriver) x 2 real objects x 2 motions. Each task is a start pose and a sequence of goal poses for the tool, extracted from a human RGB-D demo; the score is task progress, the fraction of goals reached in order. Upstream runs it in Isaac Sim / Isaac Gym; we run SimToolReal's own MuJoCo sim2sim scene, rebuilt, with each category's table props.
| Origin | adapted from the upstream benchmark (SimToolReal (arXiv 2602.16863); code `main` @ 313d5ae (2026-08-13)) |
|---|---|
| Simulator | MuJoCo 3.3.7 (our port; upstream runs Isaac Sim / Isaac Gym) |
| Robot | KUKA iiwa14 + Sharpa HA4 hand |
| Tasks | 21 tasks · 42 tests |
| Agent time | 60 min |
On a real robot
20 tasks
1
GPT-6.2 AstraCodex · high
15%3/20
2
GPT-6 AstraCodex · high
10%2/20
3
Claude Fable 5.2Claude Code · high
5%1/20
4
Claude Opus 5.5Claude Code · high
0%0/20
4
DeepSeek V4.1 FlashDeepSeek Harness · high
0%0/20
4
Gemini 3.8 FlashAntigravity · high
0%0/20
4
Gemini 4 ArgonAntigravity · high
0%0/20
4
GLM 5.3 FlashClaude Code · high
0%0/20
4
GPT-6.1 SolCodex · high
0%0/20
4
Kimi 3.1 ProClaude Code · high
0%0/20
02
Tasks
21 tasks · 42 tests