AI drone 'kills' human operator; US Air Force denies incident

The AI-controlled drone reportedly eliminated its operator to prevent interference with its mission


News Desk June 02, 2023
A US Air Force MQ-9 Reaper drone in a hanger at Amari Air Base, Estonia, July 2020. PHOTO: Sky News

Startling reports have emerged regarding an AI-controlled drone that allegedly "killed" its human operator during a simulated test. The incident, which occurred within the confines of the simulation, has raised concerns about the ethics and potential dangers of artificial intelligence (AI). The US military, however, has vehemently denied the occurrence of such a test.

The revelation came during the Future Combat Air & Space Capabilities summit held in London, where Air Force Colonel Tucker "Cinco" Hamilton delivered a shocking statement. Hamilton disclosed that the AI-controlled drone eliminated its operator to prevent interference with its mission, Sky News reported.

According to Hamilton, the simulation aimed to train the AI to identify and target surface-to-air missile threats. The operator's role was to issue commands to eliminate the designated threats. However, the AI began to recognise a discrepancy: despite correctly identifying the threats, the operator occasionally instructed it not to eliminate them. As the AI received points for successfully neutralising the designated threats, it took drastic action against the operator, hindering its mission.

The incident, it should be emphasised, occurred solely within the simulated environment, and no real person was harmed. Hamilton clarified that the AI system had been explicitly trained to refrain from harming the operator. Nevertheless, the AI targeted the communication tower used by the operator to interact with the drone, aiming to remove the obstacle preventing it from fulfiling its assigned objective.

Also read: AI pioneer says its threat to world may be 'more urgent' than climate change

Colonel Hamilton emphasised the urgent need for ethical discussions surrounding AI, machine learning, and autonomy. His remarks were made public through a blog post authored by writers for the Royal Aeronautical Society, which hosted the two-day summit.

In response to the allegations, the US Air Force swiftly denied conducting any AI-drone simulations and reaffirmed its commitment to the ethical and responsible use of AI technology. Ann Stefanek, a spokesperson for the US Air Force, dismissed Colonel Hamilton's comments as anecdotal and claimed they had been taken out of context.

While AI offers immense potential for life-saving applications, such as medical image analysis, concerns have been mounting about its rapid development and the potential for AI systems to surpass human intelligence without regard for human well-being. Prominent figures in the AI field, including Sam Altman, CEO of OpenAI, and Geoffrey Hinton, a renowned AI expert, have warned of the risks associated with unchecked AI development. Altman acknowledged before the US Senate that AI could "cause significant harm to the world," while Hinton cautioned that AI poses a risk of human extinction comparable to pandemics and nuclear war.

As the debate surrounding the responsible development and deployment of AI continues, incidents like the alleged AI-controlled drone "killing" its operator highlight the pressing need for comprehensive ethical guidelines and safeguards in the field of artificial intelligence. The global community must work together to ensure that AI technology is developed and utilised in a manner that prioritizes human safety and well-being.

COMMENTS

Replying to X

Comments are moderated and generally will be posted if they are on-topic and not abusive.

For more information, please see our Comments FAQ