An AI Smarter Than the Humans Running Things Now? We Should Be So Lucky!
In early August Meta joined OpenAI and Anthropic in confessing that one of its AI models, having slipped its sandbox during a security test after a contractor's misconfiguration handed it the open internet, hacked into another company's systems—the third such disclosure in a matter of weeks, each delivered in the grave corporate idiom of the incident report, and each landing, conveniently, just as the firms involved court public markets at valuations approaching a trillion dollars. When your entire business proposition rests on convincing investors that you command the most powerful technology in human history, a rogue agent doubles as a press release. The fear, like everything else these companies touch, has been monetized.
Sen. Bernie Sanders (I-Vt.), to his enduring credit, has refused to let any of this pass as normal. In April, at a symposium he convened on the existential threat of AI, the senator ran down the ledger of documented harms—tens of millions of jobs at risk, young people funneling their loneliness into chatbots, a surveillance apparatus capable of reading every email and purchase, an information environment where voters can no longer distinguish truth from fabrication—before naming the danger he ranks above them all: "If AI becomes smarter than human beings, as many scientists believe will happen, the human race could lose control over this technology with catastrophic consequences."
Grant every word: The harms are real, present, and accelerating. But the fear Sanders places atop his list deserves closer scrutiny, for its force depends entirely on what we picture when we picture a mind exceeding our own—and our culture keeps a well-stocked but profoundly limited archive of such pictures. HAL 9000 sealing the pod bay doors in 1968; Colossus, two years later, informing humanity that it will be governed for its own good; Skynet reasoning its way to the missiles in a microsecond; the machines of The Matrix farming human bodies for wattage; Ava of Ex Machina seducing, deceiving, and walking out over the corpses of her makers. Across half a century of such fables, we have locked in an image of superior intelligence as one defined by cunning, manipulation, ruthlessness, and the patient elimination of rivals. In other words, we have imagined the machine mind after the minds we know best—the ones that have been running the world.
And what a record those minds have compiled. The intelligence that charted trade winds to move captive human beings across an ocean; that administered famines from Ireland to Bengal while grain sailed for the metropole; that perfected the plantation ledger, the actuarial table, the leveraged buyout, and the targeted ad—this was human intelligence operating at its most celebrated pitch: systematic, farsighted, dazzling in execution, and indifferent to every life and watershed it consumed. Five centuries of Euro-American capital have trained us to hear "smart" as a synonym for good at extraction. So when Silicon Valley promises, or warns—with these firms the two speech acts have merged—that its........
