Microsoft's Custom Chips Deliver Up to 40% Efficiency Gains in AI Acceleration

Microsoft's (MSFT) stock soared by 18% in late July following record earnings, and CEO Satya Nadella credited the company's custom AI accelerators for delivering significant efficiency gains. According to Nadella, these chips are providing up to 40% efficiency-per-watt improvements over the previous generation of Microsoft Maia chips.

This breakthrough is crucial because it enables Microsoft to increase its AI infrastructure spending without incurring higher costs per unit of compute. The company's custom silicon includes the Maia accelerator and Cobalt CPU families, designed specifically for Azure workloads and Copilot-level scale.

Nadella emphasized that using its own chips reduces reliance on OpenAI's cost structure, which has previously weighed on Microsoft's net income in prior quarters. With this shift, Microsoft can better control its expenses and improve return on investment from AI spending.