Firm Using AI to Mimic Biden's Voice in Calls Fined $1 Million by FCC

A company that used artificial intelligence to send deceptive calls to New Hampshire voters has agreed to pay a $1 million fine, according to federal regulators. Lingo Telecom, the voice service provider responsible for transmitting the robocalls, settled with the Federal Communications Commission (FCC) to resolve enforcement action. Initially, the FCC had sought a $2 million fine.

The case is viewed as an early and troubling example of how AI might be used to influence voter groups and democracy. The phone messages, sent on January 21, mimicked President Joe Biden's voice and falsely suggested that voting in the state's presidential primary would prevent voters from participating in the November general election.

AI and Voter Influence

Steve Kramer, a political consultant who organised the calls, still faces a proposed $6 million FCC fine and state criminal charges. Kramer paid a magician and self-described "digital nomad" to create the recording. He told The Associated Press earlier this year that his intention was not to influence the primary's outcome but to highlight AI's potential dangers and prompt legislative action.

If convicted, Kramer could face up to seven years in prison for voter suppression and up to one year for impersonating a candidate. The FCC stated that Lingo Telecom has also agreed to strict caller ID authentication rules and requirements. The company must now verify the accuracy of information provided by its customers and upstream providers more thoroughly.

Consumer Rights and AI Transparency

FCC Chairperson Jessica Rosenworcel emphasised the importance of knowing who is on the other end of a call. "Every one of us deserves to know that the voice on the line is exactly who they claim to be," she said in a statement. "If AI is being used, that should be made clear to any consumer, citizen, and voter who encounters it. The FCC will act when trust in our communications networks is on the line."

Lingo Telecom did not immediately respond to requests for comment but had previously expressed strong disagreement with the FCC's actions, calling them an attempt to impose new rules retroactively. Nonprofit consumer advocacy group Public Citizen praised the FCC's decision. Co-president Robert Weissman said Rosenworcel was "exactly right" in asserting that consumers have a right to know when they are receiving authentic content versus AI-generated deepfakes.

Threats Posed by Deepfakes

Weissman highlighted that this case demonstrates how deepfakes pose "an existential threat to our democracy." FCC Enforcement Bureau Chief Loyaan Egal added that combining caller ID spoofing with generative AI voice-cloning technology poses significant risks. These risks are present whether domestic operatives seeking political advantage or sophisticated foreign adversaries conducting malign influence or election interference activities are involved.

The settlement with Lingo Telecom marks a significant step in addressing the misuse of AI in communications. It underscores the need for transparency and accountability in using advanced technologies that can potentially undermine democratic processes.