Nadella: Superintelligence Must Remain Under Human Control

Microsoft CEO Satya Nadella has emphasized the need for superintelligence to remain under human control, saying that any pursuit of it must be grounded in helping humanity. In a recent post on X, Nadella highlighted the importance of creating a 'frontier ecosystem' where both closed- and open-source AI models can thrive across countries, communities, and businesses.

Nadella emphasized that organizations should retain control over their unique knowledge and data, rather than becoming dependent on a single model provider. He also called for a deliberate approach to AI development, supporting concepts such as 'embedded evaluators' that ensure alignment with human goals.

The Microsoft CEO warned against advanced AI development being controlled by a handful of companies, advocating instead for broad representation across the ecosystem, countries, and fields, including academia. This approach aims to provide broad access and choice at every layer of the AI stack, while maintaining enterprise control over learning loops and models.