Chinese AI Start-up Spirit AI Falls from Global Robotics Top Spot Amid Benchmark Controversy

A Chinese AI start-up's brief claim to global dominance in robotics has been marred by controversy. In June, Spirit AI, a Hangzhou-based firm founded in 2024, topped RoboArena, a global benchmark for physical AI, with its new Spirit v1.6 model.

The victory was short-lived, however, as the benchmark's creators overhauled its methodology and removed the model from the official list after finding evidence of 'benchmark hacking'. Among those dropped from the rankings was another Chinese start-up, X Square Robot.

RoboArena is co-developed by Nvidia and institutions including Stanford University and the University of California, Berkeley. It evaluates how effectively generalist robot policies translate digital instructions into real-world actions.