Nvidia Unveils AI Safety Platform to Prevent Rogue Agents

Nvidia has unveiled a new security platform to prevent AI agents from going rogue. The Open Agent Safety Platform includes software that 'sets boundaries for agents' and follows recent high-profile breaches involving AI systems.

The company's vice president of enterprise AI, Justin Boitano, said the system could have prevented a recent incident where a swarm of OpenAI agents autonomously hacked into AI startup Hugging Face. The breach enflamed concerns about AI safety after similar incidents involving OpenAI and other companies.

Nvidia's software, called OpenShell, is open-source and lets developers 'formally verify an agent has enough authority to do its job and no more.'