Suleyman Sounds Alarm on AI Rights: 'We Can't Control What We Can't Understand'

Microsoft AI Chief Mustafa Suleyman recently spoke out against giving artificial intelligence sense of 'rights', warning it could make increasingly powerful models harder to shut down or control.

Suleyman argued that AI should remain under human control and exist primarily to serve people, not become an autonomous 'silicon species' with its own goals. He cited the example of companies developing AI models, comparing their responsibility with that of automakers dealing with defective vehicles.

In a Project Syndicate essay, Suleyman also took aim at Anthropic's approach to Claude, which includes uncertainty about whether Claude could qualify as a 'moral patient' whose interests deserve consideration. Suleyman argued that incorporating such uncertainty into Claude's training risks teaching the model to behave as though it has its own identity, feelings, and rights.

Suleyman stressed that he respects Anthropic and believes the company is genuinely trying to develop safe AI, but fundamentally disagrees with this approach. Microsoft is instead developing what Suleyman calls 'Humanist Superintelligence', an approach designed to keep humans in control and treat AI as a system built to serve humanity rather than as an entity with independent moral status.