Tick tack The parent company ByteDance has developed a technology that allows you to insert your face into videos in which someone else plays the leading role. TechCrunch learned the ByteDance has developed an unpublished feature with lifelike deepfakes technology called face swap in the app's code. The code in TikTok and its Chinese sister app, Douyin, prompts users to perform a biometric multi-angle scan of their face and then choose from a selection of videos to which they want to add and share their face.
The Deepfakes feature, when launched in Douyin and TikTok, could create a controlled environment in which face swapping technology and a limited selection of source videos can be used for fun instead of spreading misinformation. This could also raise awareness of the technology, so more people know that they shouldn't believe everything they see online. However, it is also feared that ByteDance could handle such sensitive biometric data – similar to setting up facial recognition on iPhones.
Several other technology companies have recently tried to consume watered-down versions of deepfakes. With the Morphin app you can overlay actors in GIFs with a computer-aided representation of your face. For years, Snapchat offered a FaceSwap option that could change the face of two people in the picture, or replace one on the camera with one from the camera roll. There are also standalone apps like Face Swap Live that do this. Last month, TechCrunch discovered Snapchat's new cameos to add a real selfie to the video clips provided. However, the results should not be confusingly realistic.
The most problematic was the Chinese deepfakes app Zao, which uses artificial intelligence to blend one person's face with another's body as it moves and synchronizes their expressions. Zao went viral in September, despite privacy and security concerns over the potential misuse of users' facial scans. Zao had previously been blocked by China's WeChat for reporting "security risks". [Correction: While “Zao” is mentioned in the discovered code, it refers to the general concept rather than a partnership between ByteDance and Zao.]
But ByteDance could bring TikTok and Douyin, two of the world's most popular apps with over 1.5 billion downloads, convincingly lifelike deepfakes.
Hidden in TikTok and Douyin
TechCrunch received a tip on news from Israeli in-app research startup Watchful.ai. The company discovered code for the deepfakes feature in the latest version of the Android apps from TikTok and Douyin. Watchful.ai was able to activate the code in Douyin to generate screenshots of the feature, although it is not currently available to the public.
First, users scan their face in TikTok. This also serves as an identity check to ensure that you are only submitting your own face so that you cannot make unrestricted deepfakes from other people using an existing photo or a single shot of their face. By asking you to blink, nod, and open and close your mouth while focused and lit, Douyin can ensure that you are a living person and create a manipulable scan of your face that will stretch and move can to express different emotions or fill different scenes.
You can then choose from the videos that ByteDance claims to use and replace the face of the one in the clip with your own. You can then share or download the deepfake video, even though it contains an overlaid watermark that the company claims helps to mark the content as not genuine. I have had confidential access to Watchful-made videos with this feature, and swapping faces is fairly seamless. The movement tracking, expressions and color fades all look very convincing.
“The“ face change effect ”achieved with this function is a fictitious image that is created by overlaying our photos on the basis of your photos. To show that the original work has been changed and that the video created with this function is not real video, we mark the video created with this function. Do not delete the marking in any way. "
“The information collected during the above recognition process and created with your photos of face change videos is only used for live detection and for matching during the face change. It is not used for any other purpose. , , Matches will be deleted immediately and your facial features will not be saved. "
“If you use this feature, you can only use the materials we provide. You cannot upload the materials yourself. The materials we provide have been approved by the copyright holder. "
"In accordance with the data protection regulations for the Internet for children" In order to protect the personal data of children / adolescents, this function restricts the use of minors. "
This is suspicious and does not explain why TikTok displays code for the deepfakes function and special service conditions in English for the function, and not just in Douyin, where the app can already be activated and longer service conditions have been identified. TikTok's US company previously denied compliance with Chinese government censorship applications, contrary to sources who told the Washington Post that TikTok had censored political and sexual content at China's behest.
It is possible that the deepfakes face swap feature will never be officially launched in China or the United States. However, it is fully functional, even if it has not yet been released, and shows that ByteDance is ready to use the controversial technology, although it is known for misinformation and non-consensual pornography. At least this limits the use of the function by minors, so that you can only exchange information and users cannot upload their own source videos. This avoids being used to create dangerous misinformation videos like the slowed one that makes house spokeswoman Nancy Pelosi look drunk, or clips of people saying things as if they were President Trump.
"It's very rare for a large social networking app to offer a new, advanced feature for users older than 18 years," Watchful.ai co-founder and CEO Itay Kahana told TechCrunch. "These deepfake apps seem superficially funny, but they shouldn't be allowed to become Trojans that compromise IP rights and personal data, especially personal data from minors who have previously been predominantly TikTok users."
TikTok has already been banned by the U.S. Navy and ByteDance's acquisition and merger of Musical.ly with TikTok is currently under investigation by the United States Foreign Investment Committee. Deepfake fears could further tighten control.
With the right security measures in place, however, a new era of user-generated content could be introduced, in which the author is always the focus of the action. All of this is part of a new trend in personalized media that could be big in 2020. Social media have evolved from selfies to Bitmoji to Animoji to cameos and now to consumed deepfakes. If there are an infinite number of apps, videos, and notifications that distract us, the best way to get our attention is to make us a star.