menu_open Columnists
We use cookies to provide some features and experiences in QOSHE

More information  .  Close

The Black Box Problem: CIOs Need Visibility Into AI Agent Behavior

23 0
18.06.2026

It seems every company is either using AI agents or working to deploy them across their processes. And while the technology is game-changing, one risk looms in the background: It’s not easy to know what your agents are doing. In generative AI, your AI agents tackle each issue anew—and they don’t always follow the same strategies. Just like some people, AI agents can make poor decisions—but it’s much easier to ask a person to go through the steps that led to an action.

Adding a transparency layer to AI agents can be transformative, and can improve security and efficiency—as well as insulate you from legal damages. I talked to Matan Bar-Efrat, cofounder and CEO of Rein Security, about why it’s imperative to know what your agents are doing. An excerpt from our conversation is later in this newsletter.

This is the published version of Forbes’ CIO newsletter, which offers the latest news for chief innovation officers and other technology-focused leaders. Click here to get it delivered to your inbox every Thursday.

Artificial Intelligence

The Trump administration may have a relatively hands-off policy for regulating AI models—unless the company is Anthropic. Last week, the administration ordered the enterprise AI powerhouse to immediately cut access to its most advanced Fable 5 and Mythos 5 models to any foreign national, ostensibly because users could get around safety guardrails. The end result was Anthropic shut down its two most powerful models to everyone, writes Forbes senior contributor Jodie Cook.

Anthropic acknowledged both of these systems posed big risks when they were released. Mythos, unveiled in April, was able to find critical vulnerabilities in many key systems. Anthropic tightly controlled its release, granting access to a limited group while security issues were addressed. Fable 5 was released days before the Trump administration’s ban, and Anthropic said it had guardrails to prevent using it for cyber attacks or creating bioweapons. Hours before the Trump administration’s directive to shut down Mythos 5 and Fable 5, Anthropic Chief Commercial Officer Paul Smith discussed releasing these kinds of tools with Forbes’ Richard Nieva.

“You have to make a judgment call on these things,” Smith said. “The safest you can be is to not let people use something. And then it’s totally safe. But then how is that helping the mission, and how is that helping people actually derive real value from Mythos-level intelligence?”

It’s been almost a week, and access to Fable and Mythos is still suspended. Anthropic leaders met with members of the Trump administration about the issue on Monday, but no details of that meeting are known. Several cybersecurity experts told Forbes’ Thomas Brewster this week that the ban should end—but pointed out this underscores why companies shouldn’t rely on a single platform for critical processes. .

There was already bad blood between Anthropic and the Trump administration over a canceled Pentagon contract.........

© Forbes