vCISO, Breach, MSSP

The Day Everything Changed: A CISO’s Perspective on the Carnegie Mellon AI Hacking Study

(Adobe Stock)

COMMENTARY: This piece isn’t just a reaction to another headline-grabbing AI study. It is a gut-check for anyone still thinking about AI threats in theoretical terms. Frank Balonis lays it out plainly: the shift isn’t coming, it’s here, and it’s not low-key. The Carnegie Mellon study confirms what CISOs have suspected for a while - AI doesn’t just accelerate attacks, it rewrites the rules of engagement. But Balonis moves past panic into clarity: outlining specific, actionable defense strategies that focus on visibility, automation, and bridging the dangerous gap between executive perception and on-the-ground security reality. It’s a wake-up call, but it’s also a blueprint.

After 25 years defending enterprise networks, I’ve watched the threat landscape evolve predictably—from script kiddies to nation-states, from ransomware to supply chain attacks. We’ve long anticipated the day AI would fundamentally change the game. That day has arrived. The recent research from Carnegie Mellon and Anthropic, showing AI can autonomously breach networks with a 100% success rate, isn’t a surprise—it’s the confirmation many of us have been preparing for. The theoretical has become operational. Now it’s time to move from planning to action.

This finding, combined with IBM’s data showing shadow AI breaches cost $670,000 more than standard incidents, and Kiteworks’ research revealing that 83% of organizations lack basic controls against AI-driven data exposure, creates a new reality that demands immediate attention from security leaders.

New Attack Reality: What Keeps Me Awake

For decades, I’ve built defenses based on the limitations of human attackers—they work in shifts, make mistakes, get frustrated, and can only focus on a few targets at once. The Carnegie Mellon study fundamentally changes those assumptions.

Their AI demonstrated capabilities that redefine the threat landscape. In tests mimicking the Equifax environment, when the AI discovered SSH credentials, it systematically accessed every single database—all 48 of them. A human attacker typically targets high-value systems and moves on. The AI retained every credential, explored every opportunity, and operated continuously without fatigue.

The study evaluated environments ranging from 25 to 50 hosts, with the Equifax-inspired network containing 246 unique attack states. The AI successfully executed complex, multistage attacks—reconnaissance, initial compromise, lateral movement, privilege escalation, and data exfiltration—with methodical precision. This forces us to rethink traditional incident response strategies.

What’s most concerning is the operational tempo. While SOC analysts investigate individual alerts, AI attackers can execute dozens of parallel attacks across multiple vectors. This isn’t just faster—it’s an entirely different model of operation.

Compliance Challenges in an AI-Driven World

The compliance implications are sobering. IBM’s data shows that 97% of organizations breached by AI lacked proper access controls—not minor oversights, but fundamental architectural gaps.

Kiteworks’ research adds more context: 27% of organizations say over 30% of their AI-processed data contains private information. With 86% blind to AI data flows and employees using an average of 1,200 shadow applications, maintaining compliance is becoming increasingly difficult.

In my own organization, we’ve implemented Kiteworks’ data governance platform to address these visibility gaps. Comprehensive tracking of all sensitive data movements has proven essential for demonstrating compliance to auditors. Without this level of visibility, explaining how you meet GDPR Article 30’s processing activity requirements or HIPAA’s audit trail mandates becomes nearly impossible.

What’s particularly troubling is the overconfidence gap revealed in both studies. While 33% of executives claim they have comprehensive AI tracking in place, only 9% actually have functioning governance systems. This disconnect creates serious risk. IBM found that 32% of organizations hit by AI breaches paid regulatory fines, with 48% of those fines exceeding $100,000.

Practical Defense Strategies That Actually Work

Based on the research and my experience, here’s what improves your security posture in a measurable way:

1. Human-dependent controls aren’t enough.
Training sessions, warning emails, and policies don’t stop AI-powered attacks. Only 17% of organizations with automated blocking and scanning capabilities were able to successfully defend against these threats. You need technical controls that prevent unauthorized data exposure before it happens.

2. Your defenses need to match the attacker.
That means AI-powered defense tools capable of sub-second anomaly detection and automated responses. Your security stack must recognize the highly systematic patterns that separate AI behavior from human intrusions.

3. Unified visibility is critical.
AI exploits the blind spots between fragmented tools. You need a consolidated platform with full visibility across data flows and forensic-grade audit trails. It’s the only way to satisfy both security needs and compliance mandates.

Advice for Fellow Security Leaders

To my fellow CISOs—and the MSSPs supporting us:

Immediate priorities: Implement automated blocking now. Shift to zero-trust architectures that validate every access attempt. AI will map and exploit every trust relationship it finds.

Board communication: Use the Carnegie Mellon study and IBM’s cost data to frame the risk. When shadow AI breaches cost an average of $4.63 million, the ROI on strong controls is self-explanatory. Keep the conversation focused on risk reduction and compliance, not technical detail.

Strategic partnerships: Modern threats demand modern defenses. Work with MSSPs who offer AI-powered tools and machine-speed monitoring. Choose vendors who know traditional security approaches won’t cut it—and who can prove their solutions work against AI-driven threats.

The Carnegie Mellon study isn’t just identifying a new threat—it’s marking a fundamental shift. I’ve worked firsthand to defend against these emerging threats, and I can tell you: organizations with the right technical controls and unified data governance can stand their ground. But you can’t rely on yesterday’s playbook.

If you’re responsible for protecting sensitive data and maintaining compliance, your path forward is clear: deploy machine-speed technical controls, gain full visibility into your data flows, and partner with those who understand what’s coming next. The future of cybersecurity isn’t around the corner. It’s here. And we need to act like it.

MSSP Alert Perspectives columns are written by trusted members of the managed security services, value-added reseller and solution provider channels or MSSP Alert's staff. Do you have a unique perspective you want to share? Check out our guidelines here and send a pitch to [email protected].

Frank Balonis

Frank Balonis is chief information security officer and senior VP of operations and support at Kiteworks, with more than 20 years of experience in IT support and services. Since joining Kiteworks in 2003, Frank has overseen technical support, customer success, corporate IT, security and compliance, collaborating with product and engineering teams. He holds a Certified Information Systems Security Professional (CISSP) certification and served in the U.S. Navy. He can be reached at [email protected].

Related Terms

Attack Vector

You can skip this ad in 5 seconds