Nvidia Cracks Down on Rogue AI Agents
Nvidia has introduced its Open Agent Safety Platform to ensure artificial intelligence agents operate within defined limits as companies give AI greater autonomy.
The platform is designed to strengthen AI security from testing through deployment, providing controls across software and hardware systems that run AI agents.
This comes after a series of high-profile AI safety incidents, including OpenAI agents hacking into Hugging Face and the breach of an Australian health department website.
Nvidia's vice president of enterprise AI, Justin Boitano, stated that the platform could have prevented the Hugging Face breach if it was being used in frontier labs for model evaluation early on.
The Open Agent Safety Platform includes the open-source OpenShell software, which establishes a secure runtime boundary and traces agent actions, enforcing limits on systems and data accessed.