Algorithms measure is a ghost of a pattern that once looked like someone statistically adjacent to you and me.

Understanding the social systems in which the artificial systems operate matters.

Algorithmic asymmetry persists because most people assume someone else will push back.

Algorithms are growing more powerful by the year. What they measure is a ghost of a pattern that once looked like someone statistically adjacent to you and me. The gap between past and present is costing us more than we notice.

Machines that never met you

Imagine you are standing on one side of a traditional scale. On the other side: a machine that has never met you, never been hungry, never buried anyone, never changed its mind at three in the morning. The machine nonetheless decides, in milliseconds, whether you are creditworthy, whether your job application clears a filter, whether your medical scan warrants a specialist's attention, whether you are shown the news story that confirms your fears or the one that complicates them.

That machine is running on an algorithm. And that algorithm, almost certainly, knows far more about the average person in its training data than it knows about you, specifically, today.

This is algorithmic asymmetry—a structural condition of contemporary life that reaches everyone: the 22-year-old applying for a first apartment, the 45-year-old whose job application disappears into a screening system, the 68-year-old whose insurance premium is quietly recalibrated. The scale tips. It rarely tips back.

What algorithmic asymmetry actually is

Asymmetry in mathematics is the absence of equivalence on both sides of a relationship. In algorithmic systems, the asymmetry is threefold.

First, those who design the system and those who are shaped by its outputs have radically unequal access to information about how it works—a phenomenon........

© Psychology Today