AMB  a suite of the exam · Aerial robot

AM-Bench

Aerial manipulation: a flying hexarotor with an arm presses, pulls, turns and picks.

Nine of AM-Bench's aerial manipulation tasks for its FA-Hexa, a fully actuated hexarotor that can hold any attitude while hovering, carrying a four-joint arm with a two-finger gripper: press a button and push a slider on a tilted wall, turn a valve, open a door, insert a peg, hold an inspection point high on a warehouse wall, harvest a lemon and lift a can onto a cabinet shelf. One frozen instance each; the lever task is standard only.

Originadapted from the upstream benchmark
SimulatorIsaac Lab / Isaac Sim 5.1
RobotAM-Bench FA-Hexa (hexarotor with an arm)
Tasks9 tasks · 17 tests
Agent time60 min
01

Results

2 tasks
1 Claude Fable 5.2Claude Code · high 100%2/2
1 DeepSeek V4.1 FlashDeepSeek Harness · high 100%2/2
1 Gemini 3.8 FlashAntigravity · high 100%2/2
1 GPT-6 AstraCodex · high 100%2/2
1 GPT-6.1 SolCodex · high 100%2/2
1 Kimi 3.1 ProClaude Code · high 100%2/2
7 Claude Opus 5.5Claude Code · high 50%1/2
7 GPT-6.2 AstraCodex · high 50%1/2
9 Gemini 4 ArgonAntigravity · high 0%0/2
9 GLM 5.3 FlashClaude Code · high 0%0/2
02

Tasks

9 tasks · 17 tests