menu_open Columnists
We use cookies to provide some features and experiences in QOSHE

More information  .  Close

OpenAI’s “Independent Assessment” Doesn’t Look Independent at All

1 0
yesterday

Amid months of security debacles and plummeting approval of its AI technology, OpenAI announced on Monday that four independent assessors will investigate its internal models and test the effectiveness of its safety features. It may sound like a step in the right direction, but there’s a glaring problem: The evaluators have limited access to the startup’s technology, and—in many cases—OpenAI gets to approve each member of the research teams and can choose which staff they speak to.

Many AI researchers have pointed out since yesterday’s announcement that the assessors don’t appear to have the “employee-like access” that CEO Sam Altman committed to in September.

The four assessors—METR, Apollo Research, Transluce, and Goodfire—are research labs that evaluate AI models for safety risks.

We’re working with @ApolloResearch, @METR_Evals, @TransluceAI, and @GoodfireAI on embedded assessments: giving outside experts deep access to our internal models and systems to investigate alignment and test our safeguards.

These assessments build on our ongoing alignment and…

— OpenAI........

© Mother Jones