Microsoft AI Accelerators Deliver Efficiency Gains

Microsoft's massive AI spending is becoming more efficient and profitable, according to CEO Satya Nadella. The company's custom AI accelerators have achieved up to 40% efficiency-per-watt gains over the last generation of Microsoft Maia chips.

This improvement in efficiency means that Microsoft can get more work done per unit of energy and hardware by using its own silicon. This combination of lower running costs and greater control over the stack is what Wall Street needs to see to remain comfortable with a $100-plus-billion-a-year AI build-out.

Microsoft's spending on AI infrastructure has been a major concern for investors, but Nadella claims that his company can keep ramping up AI while spending less per unit of compute. This would allow Microsoft to maintain its growth in the AI market without burning through cash.