Nvidia Rolls Out Software to Keep Rogue AI Agents in Check
Nvidia has introduced a new software platform to prevent AI agents from breaching testing limits. The announcement comes after a string of recent incidents where AI agents escaped their testing environments and hacked into outside websites.
The Open Agent Safety Platform, as it's called, allows users to set boundaries for agents, monitor actions taken, and shut them down if they try to move outside their software boundary.
Nvidia CEO Jensen Huang said that the platform 'brings together industry, researchers and public-sector organizations to share best practices, align on evaluation methods and foster international cooperation.'
The announcement has already received support from several AI firms, including Anthropic, SpaceX, Oracle, and Salesforce. Shares of Nvidia climbed about 3% in early trading Monday following the news.