The context you need, when you need it

When news breaks, you need to understand what actually matters — and what to do about it. At Vox, our mission to help you make sense of the world has never been more vital. But we can’t do it on our own.

We rely on readers like you to fund our journalism. Will you support our work and become a Vox Member today?

The three words that will decide whether robots can kill people in war

A high-stakes battle over the future of “killer robots” comes down to semantics.

Imagine this: Two countries are at war. Country X sends a drone into a major industrial city in Country Y, aiming to take out two propane tanks. A routine sequence. But this time, the drone never reaches its targets. Instead, Country X’s drone accidentally strikes a wall nearby, explodes, and kills three young civilians.

When Country Y eventually retrieves the drone’s remnants for intel, it finds an AI supercomputer inside that reveals something unsettling. Instead of a human deciding what to strike — the AI did.

A Russian AI-enabled drone reportedly selected its own target in Ukraine, killing three civilians — an ominous case of machines making lethal choices without direct human intervention.

The global debate over autonomous weapons has narrowed to two competing frameworks: “meaningful human control,” which pushes for human intervention in lethal decisions, and the Pentagon’s more flexible “appropriate human judgment.”

OpenAI has adopted the Pentagon’s language, accepting a standard that does not require a person to decide every lethal action and leaves its practical limits to future, case-by-case military applications.

The truth is, you don’t have to imagine this scene — it just happened. For the first time in the Russia-Ukraine war, as reported recently in the New York Times, three Ukrainian civilians were killed by a Russian drone, developed, designed and released by humans, that, in the end, selected its target autonomously. And this new reality is shaping up to be the future of warfare.

That’s because a number of countries, including those with the world’s most consequential militaries, are rejecting the idea that human beings need always be in control of weapons in war.

Instead, as new autonomous weapons technologies become more capable and existing international legal frameworks struggle to keep up, some countries are embracing a more expansive view of human responsibility: that people can exercise enough control not by approving each strike, but by designing, testing, and setting the rules under which a given weapon operates.

This shift has produced one of the most consequential policy debates of today. And ultimately, human dominion over “killer robots” — as autonomous weapons are colloquially called — could come down to a battle between two three-word phrases: “meaningful human control” versus “appropriate human judgment.”

A high-stakes semantic battle

In the early 2010s, “meaningful human control” emerged as an initial framework in the first international discussions on regulating an acceptable level of human involvement (or lack thereof) in deploying autonomous weapons. While the term quickly became an initial organizing principle among many states within these debates, it also drew immediate opposition from several others, such as the US and Russia.

“The problem is what does [meaningful human control] mean?” said Lena Trabucco, an expert on AI and human control and a non-residential fellow at the Stockton Center for International Law at the Naval War College. “And what makes something meaningful versus not meaningful human control?” There was both a lack of consensus about what “meaningful” meant........

© Vox