OpenAI says it is concerned that a realistic voice feature for its artificial intelligence might cause people to bond with the bot at the cost of human interactions.
The San Francisco-based company cited literature which it said indicates that chatting with AI as one might with a person can result in misplaced trust and that the high quality of the GPT-4o voice may exacerbate that effect.
"Anthropomorphisation involves attributing human-like behaviors and characteristics to nonhuman entities, such as AI models," OpenAI said Thursday in a report on safety work it is doing on a ChatGPT-4o version of its AI. "This risk may be heightened by the audio capabilities of GPT-4o, which facilitate more human-like interactions with the model."
OpenAI said it noticed testers speaking to the AI in ways that hinted at shared bonds, such as lamenting aloud that it was their last day together. It said these instances appear benign but must be studied to see how they might evolve over longer periods of time.
Socialising with AI could also make users less adept or inclined when it comes to relationships with humans, OpenAI speculated. "Extended interaction with the model might influence social norms," the report said.
"For example, our models are deferential, allowing users to interrupt and 'take the mic' at any time, which, while expected for an AI, would be anti-normative in human interactions."
OpenAI was forced to apologise to actress Scarlett Johansson in June for using something very similar to her voice in its latest chatbot, throwing a spotlight on voice-cloning tech.
Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- Her.
Johansson voiced an AI character in the film Her, which Altman has previously said is his favorite film about the technology. The 2013 film stars Joaquin Phoenix as a man who falls in love with an AI assistant named Samantha. AFP
COMMENTS
Comments are moderated and generally will be posted if they are on-topic and not abusive.
For more information, please see our Comments FAQ