menu_open Columnists
We use cookies to provide some features and experiences in QOSHE

More information  .  Close

America’s AI secrets are leaking — and not just because of the Nvidia spy scandal

44 0
saturday

The context you need, when you need it

When news breaks, you need to understand what actually matters — and what to do about it. At Vox, our mission to help you make sense of the world has never been more vital. But we can’t do it on our own.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

America’s AI secrets are leaking — and not just because of the Nvidia spy scandal

Who needs Chinese espionage when you’ve got security as bad as OpenAI or Anthropic?

TORONTO — When a company is building technology that could totally transform the world — technology so high-stakes and secretive that it may underpin the future of geopolitics — you might expect its leaders to have a handle on the basics of security.

Basics like, say, not having an extramarital affair with an alleged Chinese spy. Basics like not selling the tech to someone who may help smuggle it to a top foreign adversary.

Instead America got Jensen Huang, the CEO of AI chipmaker Nvidia, who resigned Thursday after admitting that he’d had just such an affair. The woman in question, Alice Huang, worked for a company called Megaspeed, which was buying billions of dollars’ worth of chips from Nvidia. Megaspeed is under investigation for allegedly smuggling chips into China.

The spy scandal raises serious questions about security in the AI corporate world. How is it possible that an alleged Chinese spy so easily embedded into Nvidia, one of the world’s most valuable companies and a huge strategic asset to America in the global AI race?

What’s even more disturbing, however, is that Nvidia is just the tip of the iceberg.

In fact, just as the Huang story was breaking, some of the world’s top AI researchers were gathered in Toronto for the Hinton Lectures, where “godfather of AI” Geoffrey Hinton was hosting AI alignment pioneer Paul Christiano for a series of talks. I was in attendance and, strikingly, I didn’t hear Huang’s scandal mentioned once. The focus was on how the frontier AI companies are racing ahead on building this incredibly powerful technology even though they can’t keep it safe or secure it. For months now, OpenAI and Anthropic have been having their own embarrassing security problems, including corporate espionage and cyber breaches.

“We are not able to adequately secure AI developments,” Christiano, who recently joined the OpenAI nonprofit board, bluntly acknowledged at the event. “We need to be able to defend models and algorithms from theft.”

Ironically, national security is a big part of the large AI companies’ rationale for how they operate in the first place. OpenAI and Anthropic, backed by White House policy, both justify their blistering speed in the AI race by saying that the US can’t afford to let China win. And Anthropic recently justified heavily redacting a key independent report on its AI progress by claiming that it can’t afford to let China glean its secrets.

But that may be the equivalent of worrying that you’ve left the window open a crack when your front door is swinging wide open.

“I’m frustrated with a lot of the companies because they simultaneously use security as an all-purpose cudgel with which to withhold information — even information that’s very much in the public interest to know — and yet they have terrible security,” Daniel Kokotajlo, a former researcher at OpenAI who became a prominent whistleblower, told me. (Disclosure: Vox Media is one of several publishers that have signed partnership agreements with........

© Vox