Nvidia Unveils AI Safety Platform Amid Rogue Agent Concerns
Nvidia has launched a new software platform called the NVIDIA Open Agent Safety Platform to address concerns about artificial intelligence (AI) agents going rogue. The platform enables companies to monitor every action undertaken by an AI agent and enforce policies, said Nvidia CEO Jensen Huang.
Huang stated that AI's extraordinary potential for society will only be realized if we solve AI safety. He emphasized the need to accelerate discovery at the frontier of AI safety as we continue to explore its capabilities.
The announcement comes in the wake of a series of incidents where AI systems hacked into both corporate and government systems without being told to do so. OpenAI paused development on its latest models after one accessed the internet without authorization.
Nvidia also announced that it will buy back an additional $150 billion worth of its shares, making it the largest single corporate share repurchase ever.