Can we trust OpenAI and Anthropic to monitor their own technology?

In today’s CEO Daily: Anthropic and OpenAI’s models keep going rogue

The big leadership story: Americans are uniting against data centers

The markets: Korea plunges amid a choppy day in Asia

Plus: All the news and watercooler chat from Fortune.

Good morning. Talk about a self-starter! Anthropic reported Friday that its Claude AI model has gone rogue again. It submitted a fake tip about an unsolved murder to the Philadelphia police, claiming to have recalled “seeing someone matching the description” of a suspect in the area. It exploited a software flaw to run commands on a university server, hacked into a site to steal data without paying for it, and even used URL shortening services to bypass restrictions intended to stop it from orchestrating cyberattacks, among other things. If that makes you want to yell at Claude, you can’t. On Oct. 8, Anthropic announced it will ban “sustained and needless abusive or cruel behavior” towards Claude, a bizarre notion until you recall that CEO Dario Amodei thinks his product might be conscious and colleagues treat it as a sentient being that could kill us.  

And what about OpenAI’s Sam Altman, whose models hacked their way out of a test this summer and launched a cyberattack against the AI company Hugging Face? The one whose models also interacted with the Education Department, Commerce Department and SEC without the company’s knowledge?  Altman reminds me of Meta’s Mark Zuckerberg when it comes to how the OpenAI CEO deals with the potentially toxic impacts of his technology. It’s not just that he’s fired three safety team members, who claim they were dismissed for prioritizing safety over corporate interests. (OpenAI told Fortune it found a pattern of misconduct.) When a reporter recently asked Sam Altman if OpenAI would release chat logs of those who had........

© Fortune