Nvidia-Led Coalition Launches AI Security Working Group Amid Industry Pressure

The Open Secure AI Alliance (OSAA), a coalition spearheaded by Nvidia that has grown to over 120 companies in its first week, has formed a new working group called the Shared AI Findings Exchange (SAFE) to develop AI security guidelines.

The SAFE group presented initial proposals for open comment this week at the Black Hat cybersecurity conference in Las Vegas. These proposals focus on confidential incident reporting, alerting affected parties, and blame-free analysis following AI security incidents.

Alongside these proposals, OSAA members are cataloging open-source security tools, including Nvidia's LLM vulnerability scanner Garak and Amazon's Strands Agents framework.

The group's membership includes prominent tech companies such as Adobe, BlackRock, Cisco, Intel, Microsoft, Visa, and Hugging Face. Notably absent from the list of members are Anthropic, OpenAI, and Google, despite these companies having signed an earlier open letter championed by Nvidia urging support for open-source AI development.