Microsoft Teams with AMD on AI-Powered Helios Platform
Advanced Micro Devices (AMD) has announced a new partnership with Microsoft to deploy its Helios platform, which is AMD's AI rack system. This includes AMD graphics processing units (GPUs), central processing units (CPUs), networking, and software.
The deal showcases that Microsoft believes AMD's technology is among the best options available for frontier model inference. Frontier AI models are the most advanced, and using AMD's hardware in this application highlights Microsoft's confidence in AMD's capabilities.
Inference with an AI model occurs after they're trained, and it's a different type of workload than training. Using AMD's likely cheaper products for inference makes sense because having the best product there doesn't matter quite as much as it does for training AI.