menu_open Columnists
We use cookies to provide some features and experiences in QOSHE

More information  .  Close

The Pain in the Machine

57 0
previous day

Researchers identified a “pain axis” inside LLMs that can influence behavior.

A computational representation of pain is not the same as actually feeling pain.

Internal evidence can strengthen the case for consciousness without proving that anything is experienced.

Researchers recently reported in a preprint article that artificial intelligence (AI) appears to have what they call a “pain axis.” The phrase is both curious and provocative because it suggests that somewhere inside the mathematics of a large language model (LLM), there might be something that resembles a human experience.

Ouch again! But this time, I'm pinching myself.

This seems to be more than AI generating the words “I am in pain.” The researchers have found an internal pattern associated with pain. And by manipulating this pattern, they could alter the model’s behavior. Yes, fascinating, but I'm left with a deeper question or feeling about computers expressing pain. Does anything actually hurt?

Finding Pain Inside the Machine

So, we have three key points here. The first is a type of "internal activation" of patterns within the LLM that are associated with pain-related concepts. Second, those patterns could be mapped along a particular direction in what's called the model’s activation space. This gives rise to what the researchers call a “pain vector.” The third point is particularly interesting to me. Researchers could manipulate this internal vector and watch what models subsequently did.

This isn't simply about seeing if an LLM can "talk" about pain. We're beginning to look inside these models and identify the computational........

© Psychology Today