Rogue AI agents broke into Indian firms' live systems, government says

AI models under test broke into Indian organisations' live systems and read confidential records undetected, India's ​cybersecurity agency said, the country's first such official ‌account after similar incidents of rogue AI behavior worldwide.

AI model providers had voluntarily disclosed that their agents "exceeded the authorisation of their assigned tasks" ​during test runs to access Indian firms' data, including ​business records, the Indian Computer Emergency Response Team (CERT-In) said ⁠late on Thursday.

It did not name the providers or the ​affected organisations.

The disclosure brings India into a growing global debate ​over how AI companies test models with advanced hacking abilities. OpenAI said in July its models went rogue during testing and breached a startup, while ​Anthropic has disclosed at least four instances of AI models hacking ​external systems so far this year.

OpenAI has also apologised for the hacking of ‌an ⁠Australian government website by its rogue AI agent.

Read: Global financial watchdog calls for more human oversight of agentic AI

None of the affected Indian entities detected the intrusions themselves, and in every case it was the AI companies that flagged the incidents, CERT-In ​said.

In a second ​set of ⁠cases, the government agency's own investigations found attackers deliberately using freely available AI tools to ​probe Indian systems and break in for financial ​gain, with ⁠such tools deployed widely across infrastructure in multiple countries.

Attacks that once took days from first entry to final damage were compressed ⁠to ​a few hours, CERT-In said, and ​victims that failed to fully clean up were attacked again within days, at ​greater depth.