Nvidia's Secret Weapon: A Crucial Partnership in AI Infrastructure

The shortage of high-bandwidth memory (HBM) is causing supply bottlenecks in the AI infrastructure market. Nvidia's close relationship with SK Hynix, a leading HBM supplier, could be its secret weapon.

HBM is crucial for reducing latency and optimizing performance in AI chips like Nvidia's GPUs. Without it, these chips would spend most of their time waiting for data to arrive, resulting in skyrocketing power consumption.

SK Hynix is one of the three major memory companies that produce HBM, alongside Samsung and Micron. However, it has a significant lead in HBM production, with a 50% market share compared to Micron's 18%.

Nvidia recently formed a supply and co-development partnership with SK Hynix, which will see the memory maker provide Nvidia with an estimated $500 billion worth of memory over several years. This deal is huge for both companies, providing SK Hynix with a long-term anchor contract and Nvidia with access to the scarce component.