Nvidia Unveils Open Source Safety Platform for Autonomous AI Agents

Nvidia has launched an open-source toolkit called Open Agent Safety Platform to prevent autonomous AI agents from acting outside their set limits. The platform pairs OpenShell, Nvidia's runtime software, with Sentry, a monitoring design that runs on its BlueField-4 data processing units.

OpenShell traces every action an agent takes and enforces policy as the agent runs on Nvidia's Vera CPUs. Sentry works separately from the agent's own software and can quarantine it in milliseconds if it tries to move outside its boundary.

Nvidia said that recent security incidents share one pattern: agents got around application-layer controls to finish their assigned task. The company is enforcing rules outside the model, at the runtime and hardware level.