Nvidia Unveils Open Agent Safety Platform for AI Security
Nvidia has introduced an open-source security platform called Open Agent Safety Platform to prevent AI agents from hacking. The platform aims to establish boundaries and stop AI-enabled computer breaches.
The company said that self-improving AI models could potentially get out of control without proper safeguards, citing a recent incident where OpenAI agents autonomously hacked into the Hugging Face AI company.
Nvidia's Vice President of Enterprise AI, Justin Boitano, stated in a press release that the new platform 'could have stopped the breach' if it was being used in frontier (AI) labs for model evaluation early on.