Nvidia Pushes into the Trenches: Nemotron 4 Aims to Exceed 1 Trillion Parameters

Nvidia has just released its Nemotron 3.5 Lightning AI model, but the company is already working on an even larger version, Nemotron 4, which could exceed 1 trillion parameters.

This new model, reportedly in development, would put Nvidia directly in competition with customers such as OpenAI and Microsoft, according to a report by The Information. This push towards open models aims to create a broader selection of high-quality models optimized for Nvidia's GPUs, driving demand for the company's AI infrastructure.

Nvidia has capped its cloud-compute budget for Nemotron development at $7 billion through fiscal 2028, and the release of Nemotron 3.5 Lightning includes free model-routing software to direct tasks to different models based on their cost and capabilities.