AI introduces Voice cloning tool, put measures in place to tackle fake audios

Open AI has revealed that it plans to keep tightly a voice cloning tool until measures are in place to thwart fake audios meant to dupe listeners.

According to the new AI tool known as Voice Engine” the feature can essentially duplicate someone’s speech based on a 15-second audio sample, according to an OpenAI blog post sharing results of a small-scale test of the tool.

“We recognize that generating speech that resembles people’s voices has serious risks, which are especially top of mind in an election year,” the San Francisco-based company said.

“We are engaging with U.S. and international partners from across government, media, entertainment, education, civil society and beyond to ensure we are incorporating their feedback as we build.”

Disinformation researchers fear rampant misuse of AI-powered applications in a pivotal election year thanks to proliferating voice cloning tools, which are cheap, easy to use and hard to trace.

Acknowledging these problems, OpenAI said it was “taking a cautious and informed approach to a broader release due to the potential for synthetic voice misuse.”

The cautious unveiling came a few months after a political consultant working for the long-shot presidential campaign of a Democratic rival to Joe Biden admitted being behind a robocall impersonating the US leader.

The AI-generated call, the brainchild of an operative for Minnesota congressman Dean Phillips, featured what sounded like Biden’s voice urging people not to cast ballots in January’s New Hampshire primary.

It must also be made clear to audiences when voices they are hearing are AI generated, the company added.

“We have implemented a set of safety measures, including watermarking to trace the origin of any audio generated by Voice Engine, as well as proactive monitoring of how it’s being used,” OpenAI said.