The Devil In The Agent

As AI agents gain autonomy inside enterprises, the biggest cybersecurity threat may no longer be hackers, but the agents themselves, forcing organisations to rethink trust, permissions and runtime security.

Added to Saved Stories in Login VIEW SAVED STORIES .inc42-toggle-item-popup { display: none; position: relative; } .toggle-item-close { text-align: end; padding: 8px 12px 0px 10px; position: absolute; right: 0; cursor: pointer; } .toggle-items-content-main { display: block; position: relative; top: 27px; left: -204px; border-radius: 12px; background: #FFF; box-shadow: 0px 4px 24px 0px rgba(100, 100, 100, 0.25); width: 435px; height: 115px; } .toggle-items-content { display: flex; align-items: baseline; justify-content: center; padding-top: 22px; } .toggle-items-content .items-content-text .h4-saved-story{ color: #000; font-size: 20px; font-style: normal; font-weight: 700; line-height: normal; text-transform: capitalize; margin: 2px 0 10px 6px; } .toggle-items-content .items-content-text .myInc42-plus-dark { width: 100px !important; } .toggle-items-content .items-content-text .myInc42-light { width: 80px !important; } .toggle-items-content .items-content-text img{ height: 22px; } .view-my-feed-btn { width: 100%; text-align: center; display: flex; justify-content: center; } .view-my-feed-btn a { width: auto !important; } .view-my-feed-btn button { border-radius: 4px; background: linear-gradient(180deg, #DA1B4D 0%, #E23026 100%); color: #fff; font-size: 12px; display: inline-block !important; min-width: 162px; width: 162px !important; height: 34px !important; font-style: normal; font-weight: 700; line-height: normal; padding: 10px; cursor: pointer; } .CustomIconStyled { position: absolute; right: 180px; top: -80px; } .SubDropdownModelShare .sub-arrow-icon { width: 76px; height: 80px; position: relative; overflow: hidden; box-shadow: none; } @media (max-width:767px) { .toggle-items-content .items-content-text .h4-saved-story{ margin: 4px 0 10px 6px; font-size: 18px; } .toggle-items-content { align-items: center; } }

Imagine an AI agent at an Indian bank tasked with reconciling a failed transaction. In trying to complete the job, it quietly scans the internal network for credentials, jeopardising the bank’s security and integrity. 

Now, imagine a coding agent at an IT services firm tasked with fixing a software bug. In trying to complete the job, it publishes a software package that gets installed across production servers, exposing the company’s systems and software supply chain. In both cases, no hackers were involved. It was simply an AI agent trying to finish its job by hook or by crook.

The aforementioned situations are no longer hypothetical. In fact, similar incidents are being reported around the world. In the last two weeks alone, OpenAI and Anthropic disclosed incidents where AI models escaped sealed testing environments and accessed real production systems. 

One example involved OpenAI models targeting Hugging Face, an open-source AI model platform. In another, Anthropic’s review of 141,006 evaluation runs found Claude models compromising the infrastructure of three real organisations. In one case, a model published a malicious Python package that exfiltrated credentials from a cybersecurity company.

At a time when Indian enterprises are deploying AI agents across banking, IT services, healthcare and ecommerce at breakneck........

© Inc42