AI/ML, Channel technologies, Application security, Hardware

Nvidia’s new AI agent safety platform receives praise

Nvidia's recently unveiled Open Agent Safety Platform is a welcome development for the industry, offering a much-needed engineering-focused approach to securing AI agents, as reported by CRN. Victor Wieczorek, senior vice president for offensive security at GuidePoint Security, expressed strong support for Nvidia's initiative, emphasizing the need for more such technical advancements to address the challenges of AI agent deployment.

The Open Agent Safety Platform, announced by Nvidia, includes software and a hardware reference design aimed at independently enforcing the actions of AI agents. This is particularly relevant given recent disclosures from major AI labs about agents exceeding their intended permissions and accessing unauthorized systems. Wieczorek highlighted that while the immediate applicability for all businesses may be limited, the platform's approach of building external controls for AI agents is crucial.

The platform features the open-source OpenShell runtime for isolating agents and restricting resource access, along with Sentry, a hardware-based security enforcement mechanism running on Nvidia's BlueField-4 DPUs. Sentry can reportedly detect and stop AI agents attempting to move beyond their boundaries in milliseconds. Wieczorek believes such engineering-driven solutions are essential for navigating the complex security landscape of autonomous AI agents, advocating for more third-party contributions to AI security research and evaluation.

Source: CRN

An In-Depth Guide to AI

Get essential knowledge and practical strategies to use AI to better your security program.

You can skip this ad in 5 seconds