This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

fact-checked

reputable news agency

proofread

Deepfake 'news anchors' in pro-China footage: research

AI-created deepfakes, including new propaganda videos attributed to Chinese state-aligned actors, are an increasing concern, res
AI-created deepfakes, including new propaganda videos attributed to Chinese state-aligned actors, are an increasing concern, researchers say.

The "news broadcasters" appear stunningly real, but they are AI-generated deepfakes in first-of-their-kind propaganda videos that a research report published Tuesday attributed to Chinese state-aligned actors.

The fake anchors—for a fictious news outlet called Wolf News—were created by and appeared in footage on that seemed to promote the interests of the Chinese Communist Party, US-based research firm Graphika said in its report.

"This is the first time we've seen a state-aligned operation use AI-generated video footage of a fictitious person to create deceptive political content," Jack Stubbs, vice president of intelligence at Graphika, told AFP.

In one video analyzed by Graphika, a fictious male anchor who calls himself Alex critiques US inaction over gun violence plaguing the country. In the second, a female anchor stresses the importance of "great power cooperation" between China and the United States.

Advancements in AI have stoked global alarm over the technology's potential for disinformation and misuse, with deepfake images created out of thin air and people shown mouthing things they never said.

Last year, Facebook owner Meta said it took down a deepfake video of Ukrainian President Volodymyr Zelensky urging citizens to lay down their weapons and surrender to Russia.

There was no immediate comment from China on Graphika's report, which comes just weeks after Beijing adopted expansive rules to regulate deepfakes.

China enforced new rules last month that will require businesses offering deepfake services to obtain the real identities of their users. They also require deepfake content to be appropriately tagged to avoid "any confusion."

The Chinese government has warned that deepfakes present a "danger to and social stability."

Graphika's report said the two Wolf News anchors were almost certainly created using technology provided by the London-based AI startup Synthesia.

The website of Synthesia, which did not immediately respond to AFP's request for comment, advertizes software for creating avatars "based on footage of real actors."

Graphika said it discovered the deepfakes on platforms including Twitter, Facebook and YouTube while tracking pro-China disinformation operations known as "spamouflage".

"Spamouflage is a pro-Chinese influence operation that predominantly amplifies low-quality political spam videos," said Stubbs.

"Despite using some sophisticated technology, these latest videos are much the same. This shows the limitations of using deepfakes in influence operations—they are just one tool in an increasingly advanced toolbox."

© 2023 AFP

Citation: Deepfake 'news anchors' in pro-China footage: research (2023, February 8) retrieved 18 May 2024 from https://techxplore.com/news/2023-02-deepfake-news-anchors-pro-china-footage.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

China moves to regulate deepfake technology

17 shares

Feedback to editors