Nvidia Releases Nemotron 3.5 Lightning and NeMo Switchyard

Nvidia Corp. released Nemotron 3.5 Lightning and NeMo Switchyard to provide enterprises with more flexible and efficient AI capabilities. Nemotron 3.5 Lightning is a 30 billion-parameter mixture-of-experts open model built for high-volume, always-on agents. The company claims the model delivers up to four times the output speed and 30% faster task completion than comparable models in its weight class.

To manage the selection process between different AI models, the company introduced NeMo Switchyard. This open-source routing library directs prompts to the most efficient model based on developer priorities such as quality, speed, or cost. The Nemotron 3.5 Lightning model can be further customized using proprietary enterprise data via Nvidia NeMo.

Nvidia is collaborating with partners including Siemens AG and Langchain Inc. to integrate these tools into developer workflows. CodeRabbit utilized Nvidia's auto model recipe to create a router agent in approximately two hours for a cost of $85.