Microsoft CEO Emphasizes Human Control Over Superintelligence

Microsoft CEO Satya Nadella emphasized the importance of keeping superintelligence under human control. Speaking on X, he stated that the pursuit of AI technology surpassing humans in cognitive tasks should focus on helping humanity and remain under human control.

Nadella called for a broader adoption of AI through what he described as a 'frontier ecosystem' where both closed- and open-source AI models can thrive across countries, communities, and businesses. He added that organizations should be able to build AI systems using their own data rather than becoming dependent on a single model provider.

Nadella also emphasized the need for a deliberate approach to AI development, citing Microsoft's support for concepts such as 'embedded evaluators.' He welcomed research and focus on getting alignment right as the design goal. Additionally, he mentioned that advanced AI development should not be controlled by a handful of companies, but rather have broad representation across the ecosystem.

Nadella's comments come as debate intensifies over the rapid pace of AI development and the risks posed by increasingly capable systems. In an interview with CBS News, Anthropic CEO Dario Amodei warned that 'there are real dangers' in the industry, adding that for too long, companies had lied to people about the fact that this technology had risks.