Nadella Joins Growing Debate Over Safety of Advanced AI Systems

Microsoft CEO Satya Nadella has joined a growing debate over the safety of advanced artificial intelligence systems, warning that any pursuit of superintelligence must remain grounded in human control and oversight.

Nadella's comments come amid concerns that the rapid development of increasingly powerful AI could create risks that are difficult for humans to manage. Anthropic CEO Dario Amodei has also warned about the dangers of a competitive race between companies, where safety measures struggle to keep pace with the capabilities of the technology being developed.

Nadella welcomed greater research and 'deliberate pacing' to ensure that AI systems are developed with alignment and safety built into their design. He also expressed support for the use of embedded evaluators, a proposal raised by Amodei and OpenAI CEO Sam Altman as a way to continuously assess the safety of advanced AI systems.

The Microsoft chief argued that AI development should not be concentrated among a small group of companies, but must have broad representation across the ecosystem, countries, and fields, including academia. He also outlined Microsoft's broader approach to AI, stressing the importance of giving businesses greater control and choice across the technology stack.