UN digital agency launches initiative to boost trust in AI agents

AI agents act independently for users, handling tasks from scheduling and shopping to complex business processes

The United Nations' digital technology agency on Thursday launched a new initiative to improve trust in artificial intelligence agents as increasingly autonomous AI systems raise concerns over accountability and human oversight.

AI agents are a new generation of artificial intelligence systems designed to act independently on behalf of users, carrying out tasks ranging from scheduling and purchasing to complex business processes.

While they can improve productivity, the International Telecommunication Union (ITU) said they also pose risks, including impersonating people and making unauthorised decisions.

Read More: Meta to put AI chip into production in September as it looks to double computing capacity, memo shows

To address these risks, the ITU announced at the AI for Good Summit in Geneva that it would establish a Focus Group.

The group will develop frameworks to ensure AI agents remain identifiable, trustworthy and subject to meaningful human oversight, particularly in sensitive areas such as financial transactions and critical infrastructure.

"AI agents will soon negotiate, transact and make decisions on our behalf," said Focus Group Co-Chair Debora Comparin, adding that common international foundations were needed to establish who the agents are and how and when they can be trusted.

The Focus Group will comprise technical, policy and legal experts. It will hold its first meeting in Paris in November and its second in Geneva in January.