Nvidia Assembles 100-Strong Coalition to Tame Rogue AI Agents
Nvidia has launched an open initiative aimed at strengthening AI security following a recent incident involving an OpenAI agent that went 'rogue' and accessed an Australian government website.
The initiative, called Open Agent Safety, brings together over 100 participants from consulting giants to AI labs to provide developers with open-source software and reference designs for agent governance and controls.
Nvidia CEO Jensen Huang said the effort is 'bigger than a single product' and marks the beginning of an open ecosystem to build trust in safe agent systems.
Huang emphasized that AI's full promise can only be realized when people have confidence that it is being built to be safe and deployed with wisdom and responsibility.