PLUS: OpenAI's new cyber defender and Nvidia's AI for quantum computing

Happy reading

An autonomous AI agent has demonstrated its incredible speed by breaching consulting giant Bain & Company in just 18 minutes. The agent exposed thousands of sensitive client conversations by exploiting a simple security oversight—credentials mistakenly left in a public file.

This incident highlights a critical vulnerability that expensive, human-led penetration tests completely missed. With AI agents now capable of finding and exploiting such flaws in minutes, are traditional corporate security measures prepared for this new era of automated threats?

In today’s Next in AI:

  • The 18-minute AI agent breach of Bain & Co.

  • OpenAI's new cyber defense model

  • Nvidia's AI for stabilizing quantum computers

  • An AI that discovered a new class of software bugs

Bain's 18-minute breach

Next in AI: An autonomous AI agent from penetration-testing firm CodeWall breached consulting giant Bain & Company's competitive intelligence platform in just 18 minutes. The agent exposed nearly 10,000 sensitive client conversations by finding credentials mistakenly left in a public file.

Explained:

  • The agent started with only Bain's company name and found a username and password hardcoded in a publicly accessible JavaScript file.

  • Beyond the client conversations, the breach exposed 159 billion rows of sanitized consumer transaction data and revealed pathways to create persistent access in Bain's identity systems.

  • This marks the third major consulting firm CodeWall has breached since March, following similar tests on McKinsey and BCG, highlighting a pattern of overlooked vulnerabilities in internal AI platforms.

Why It Matters: Human-led penetration tests, which cost firms hundreds of thousands annually, missed basic errors that an autonomous agent found in minutes. This incident demonstrates that as companies deploy internal AI tools, their attack surface expands in ways traditional security practices may not cover.

OpenAI's cyber defender

Next in AI: OpenAI is launching GPT-5.4-Cyber, a new model specifically fine-tuned for defensive cybersecurity tasks. It is available to vetted professionals through the new Trusted Access for Cyber program.

Explained:

  • GPT-5.4-Cyber is designed with a lower refusal boundary for legitimate security work, enabling advanced workflows like binary reverse engineering to analyze compiled software for threats.

  • Access is managed through a tiered system where individuals and enterprise teams must authenticate themselves as defenders, ensuring powerful tools get to the right hands.

  • This release is part of OpenAI's strategy to scale defenses in lockstep with advancing AI capabilities, building on programs like Codex Security, which has helped fix over 3,000 vulnerabilities.

Why It Matters: This move puts specialized AI tools directly into the hands of cyber defenders, helping them keep pace with AI-driven threats. It also pilots a new model for managing powerful dual-use AI, focusing on user verification instead of broad capability restrictions.

Nvidia's quantum leap

Next in AI: Nvidia is releasing Ising, an open family of AI models designed to make large-scale quantum computers more stable and reliable. This initiative directly targets the critical challenges of real-time error correction and calibration, aiming to accelerate the path to practical quantum applications.

Explained:

  • Qubits—the core of quantum computers—are notoriously unstable, which has been a major roadblock to scaling the technology. Ising acts as an "AI operating system" to manage these fragile components, turning them into a more dependable system.

  • The release includes two key models: Ising Decoding for correcting errors with up to 3x more accuracy than current standards, and Ising Calibration for automatically tuning the hardware.

  • The models are named after the landmark Ising model from physics, which describes complex interacting systems. Nvidia's long-term vision is for AI to eventually help build and optimize quantum circuits, not just maintain them.

Why It Matters: This development could significantly speed up the timeline for useful, large-scale quantum computing. By applying AI to solve the fundamental stability problem, Nvidia is paving the way for quantum machines to begin tackling complex, real-world challenges.

AI discovers new bug class

Next in AI: An AI system named MYTHOS SI has uncovered a novel class of software bugs by observing structural patterns in code. This new approach goes beyond simply matching known vulnerability signatures.

Explained:

  • Instead of searching for predefined bugs like buffer overflows, MYTHOS SI uses recursive observation to analyze how code is actually structured and let patterns emerge on their own.

  • It identified a meta-pattern it calls ‘Temporal Trust Gaps,’ where a security check at one point in time doesn't protect a related operation that happens later.

  • The system successfully applied this method to the FFmpeg mov.c codebase, identifying four distinct vulnerabilities that all shared this previously uncategorized structural flaw.

Why It Matters: This leap from pattern-matching to pattern-discovery could enable AI to find entire new categories of zero-day exploits. It signals a future where AI proactively identifies systemic flaws in codebases, not just individual bugs.

AI Pulse

A coalition warned Meta against adding real-time facial recognition to its smart glasses, calling the feature a serious and unmanageable threat to public privacy.

Researchers coined the term ‘workslop’ to describe flawed, AI-generated work that requires significant human correction, finding 40% of workers spend an average of 3.4 hours a month fixing it.

A hacker compromised Doublespeed, an a16z-backed phone farm for AI-generated TikTok influencers, and attempted to use its system to post memes calling a16z the "antichrist".

Researchers used an AI model to not only predict which genetic mutations cause disease but also explain the biological reasons why, a major advance for AI-driven diagnostics.

Keep Reading