UN digital agency launches initiative to boost trust in AI agents
the ITU announced at the AI for Good Summit in Geneva that it would establish a Focus Group. PHOTO:PEXELS
The United Nations' digital technology agency on Thursday launched a new initiative to improve trust in artificial intelligence agents as increasingly autonomous AI systems raise concerns over accountability and human oversight.
AI agents are a new generation of artificial intelligence systems designed to act independently on behalf of users, carrying out tasks ranging from scheduling and purchasing to complex business processes.
While they can improve productivity, the International Telecommunication Union (ITU) said they also pose risks, including impersonating people and making unauthorised decisions.
To address these risks, the ITU announced at the AI for Good Summit in Geneva that it would establish a Focus Group.
The group will develop frameworks to ensure AI agents remain identifiable, trustworthy and subject to meaningful human oversight, particularly in sensitive areas such as financial transactions and critical infrastructure.
"AI agents will soon negotiate, transact and make decisions on our behalf," said Focus Group Co-Chair Debora Comparin, adding that common international foundations were needed to establish who the agents are and how and when they can be trusted.
The Focus Group will comprise technical, policy and legal experts. It will hold its first meeting in Paris in November and its second in Geneva in January.