AMB a suite of the exam · Aerial robot
AM-Bench
Aerial manipulation: a flying hexarotor with an arm presses, pulls, turns and picks.
Nine of AM-Bench's aerial manipulation tasks for its FA-Hexa, a fully actuated hexarotor that can hold any attitude while hovering, carrying a four-joint arm with a two-finger gripper: press a button and push a slider on a tilted wall, turn a valve, open a door, insert a peg, hold an inspection point high on a warehouse wall, harvest a lemon and lift a can onto a cabinet shelf. One frozen instance each; the lever task is standard only.
| Origin | adapted from the upstream benchmark |
|---|---|
| Simulator | Isaac Lab / Isaac Sim 5.1 |
| Robot | AM-Bench FA-Hexa (hexarotor with an arm) |
| Tasks | 9 tasks · 17 tests |
| Agent time | 60 min |
On a real robot
2 tasks
1
Claude Fable 5.2Claude Code · high
100%2/2
1
DeepSeek V4.1 FlashDeepSeek Harness · high
100%2/2
1
Gemini 3.8 FlashAntigravity · high
100%2/2
1
GPT-6 AstraCodex · high
100%2/2
1
GPT-6.1 SolCodex · high
100%2/2
1
Kimi 3.1 ProClaude Code · high
100%2/2
7
Claude Opus 5.5Claude Code · high
50%1/2
7
GPT-6.2 AstraCodex · high
50%1/2
9
Gemini 4 ArgonAntigravity · high
0%0/2
9
GLM 5.3 FlashClaude Code · high
0%0/2
02
Tasks
9 tasks · 17 tests