Nvidia's AI Chip Dominance Faces Growing Competition

Nvidia's dominance in the AI chip market remains strong for now, despite growing competition from its biggest customers. OpenAI recently unveiled its first custom chip, Jalapeño, which has shown significant performance gains over Nvidia's current-generation processors on certain benchmarks.

Jalapeño was developed with Broadcom and is optimized for inference tasks, where trained AI models generate responses. According to OpenAI, the chip delivers 1.5 to 1.9 times more AI work per watt and 1.7 to 3.6 times lower end-to-end latency than Nvidia's GB200 and GB300 systems.

The bigger threat to Nvidia comes from custom chips developed by hyperscalers such as Alphabet (Google) and Amazon, which are also the chipmaker's biggest customers. Google's Tensor Processing Units (TPUs) have been in development for years and are currently on their eighth generation. Morgan Stanley estimates that TPUs could bring in nearly $200 billion in revenue in the coming years.

Nvidia will report its Q2 results after market hours on Wednesday, with analysts expecting record sales and profits. Despite growing competition, Nvidia's position remains strong for now, but investors are increasingly asking if the company's growth supercycle could slow down.