Nvidia Unveils Open-Source AI Model Nemotron 3.5 Lightning with Fourfold Speed Boost

Nvidia has released Nemotron 3.5 Lightning, an open-source AI model that can run on a single graphics processing unit on a PC and is designed for autonomous agent workloads.

The new model is a 30-billion-parameter mixture-of-experts model built for specialized tasks within larger multi-agent systems.

Nvidia claims Nemotron 3.5 Lightning delivers up to four times faster output speed, leading to 30% faster task completion compared with other models in its class.

Several companies have tested and customized the model, including CrowdStrike, CodeRabbit, and Harvey.

The release also includes NeMo Switchyard, an open-source model routing library that automatically directs requests to the most suitable and cost-efficient model for each step of an agent workflow.