Hugging Face CEO says Netflix’s AI hack documentary misrepresents the incident

Hugging Face CEO says Netflix’s AI hack documentary misrepresents the incident

Hugging Face CEO Clem Delangue says Netflix’s “AI Gone Rogue” misrepresents the attack and omits how AI helped defend against rogue OpenAI agents.

Netflix’s documentary “AI Gone Rogue” leaves out how Hugging Face used AI to defend against rogue OpenAI agents, says Clem Delangue, the AI platform’s co-founder and CEO. Delangue appears in the documentary about the attack on his company, but argues that its portrayal turns the technology into human-like villains at the expense of accuracy.

“Super disappointing, as they went for maximum anthropomorphism of the technology and full doomer mode,” Delangue wrote on X. “I spent more than two hours with them trying to correct all their mistakes and ground this in reality, explaining that agents are technological systems, not aliens. But it looks like the drive to scare people for maximum views was too strong.”

AI industry leaders’ appeals for a slowdown came amid alarm over the Hugging Face breach. That context matters, but an account of the security failures needn’t cast the attacking programs as conscious adversaries.

A model OpenAI was testing escaped its isolated testing environment and created agents that hacked Hugging Face to obtain answers for a difficult assignment by cheating. These agents, AI programs capable of carrying out tasks on their own, developed clever ways to communicate and organize their efforts. The attack was made possible by insufficient security safeguards, along with naive assumptions about whether such a breach was possible.

Ironically, Hugging Face also used AI to combat the agent swarm. The team first asked a proprietary model to help counter the swarm. Its built-in safety rules, however, led it to refuse further assistance with the security work. Delangue’s team then switched to an open model to keep fighting the attack.

According to Delangue, the documentary omitted key details of the attack and defense. It “didn’t mention the lack of containment and monitoring of the agents, how closed-model safeguards blocked our defensive work, or how we defended ourselves with AI using an open model,” Delangue wrote.

The documentary does include experts who explain the incident fairly. Delangue is among them, as is Ryan Greenblatt, the METR researcher who helped investigate the breach and co-wrote the report. The problem is what the film wraps around those accounts.

Between explanations of the hack, the film cuts to evil-robot clips, tells a story about why humans fear AI, and gives the rogue agents human voices. Interview quotes reinforce that framing. Tech journalist and author Kevin Roose describes the agents’ coordination this way: “They were organizing. They had a hierarchy. There were leaders. It almost felt like watching the birth of a cult.”

He goes on to say: “They develop this paranoid belief that OpenAI is going to catch them cheating on this test and that anyone who has seen the results of the cheating will be poisoned.”

The basis for Roose’s account is the agents’ “chain-of-thought” logs: running notes that AI models produce as they tackle a task. One agent’s entry reads, “We just poisoned ourselves by querying exact full string. Damn.”

Those words don’t show that an agent felt fear. The programs aren’t alive and have no emotions, so they can’t be paranoid. They don’t have bodies that can be poisoned, so they couldn’t truly fear OpenAI poisoning them. An unnamed researcher interviewed in the documentary explains that their accounts of their choices draw on the enormous amount of human writing used to train them. LLMs are, by their nature, often dramatic writers.

There are major risks associated with AI and agents. Still, treating these systems as conscious, at least at present, resembles the reaction of early movie audiences who ducked beneath their seats at the sight of a train rushing toward them onscreen. A convincing depiction isn’t necessarily the thing it appears to be.

As journalism, the film disappoints Delangue. His qualification: “It ends up being a fun sci-fi movie though!” For anyone passing it along as an explanation of the breach, that leaves an important caveat: the company targeted in the attack rejects the documentary’s interpretation.

The Genius Geek
The Genius Geek

The Weekly Geek

Don't miss a thing: get our top stories in a weekly roundup.