Nvidia Enters Model Routing Market with NeMo Switchyard Launch

Nvidia has entered the market for model routers, a technology that optimizes AI inferencing costs by directing prompts to the most suitable models. Model routing is gaining attention as a way to reduce costs and improve results in AI development.

Nvidia's solution, NeMo Switchyard, provides a library of routing approaches that developers can use to build more efficient agents. Cloudflare recently introduced its own model router, part of a new suite of enterprise AI tools, while Stripe is reportedly looking to acquire OpenRouter.