Microsoft Unveils Next-Gen AI Accelerator Maia 200 for Azure Data Centers

Microsoft has taken a significant step in its pursuit of advanced artificial intelligence (AI) capabilities by unveiling its second-generation AI accelerator, Maia 200. This new chip is set to be deployed within Microsoft's Azure data centers and marks a major milestone for the company in its efforts to develop its own custom-designed AI accelerators.

The Maia 200 boasts an impressive array of features, including a 3nm chip design, 140 billion transistors, and a total chip TDP of just 750 Watts. This is achieved through the use of six stacks of HBM3e memory, which provides 7TB/second of bandwidth.

The chip's architecture has been designed with a focus on scalability, determinism, and high-performance computing. Microsoft's Software Defined Local Access (SLDA) dataflow architecture allows for efficient data movement and access within the compute elements, reducing cross-talk and bandwidth needs.