Stocks
Nvidia Enters Model Routing Market with NeMo Switchyard
Nvidia has entered the market for model routers, technology that directs AI prompts to the most efficient models. This approach keeps costs down by examining each prompt and directing it to the cheapest available model that can respond effectively.
The move comes as interest in model routing grows, with Cloudflare recently introducing a model router as part of its new suite of enterprise AI tools.
Nvidia's take on this technology is called NeMo Switchyard, which provides a library for applying multiple routing approaches and enables developers to build more efficient, controllable agents.