Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework

Sensors (Basel). 2022 Jun 22;22(13):4697. doi: 10.3390/s22134697.

Abstract

In the era of rapid development of the Internet of things, deep learning, and communication technologies, social media has become an indispensable element. However, while enjoying the convenience brought by technological innovation, people are also facing the negative impact brought by them. Taking the users' portraits of multimedia systems as examples, with the maturity of deep facial forgery technologies, personal portraits are facing malicious tampering and forgery, which pose a potential threat to personal privacy security and social impact. At present, the deep forgery detection methods are learning-based methods, which depend on the data to a certain extent. Enriching facial anti-spoofing datasets is an effective method to solve the above problem. Therefore, we propose an effective face swapping framework based on StyleGAN. We utilize the feature pyramid network to extract facial features and map them to the latent space of StyleGAN. In order to realize the transformation of identity, we explore the representation of identity information and propose an adaptive identity editing module. We design a simple and effective post-processing process to improve the authenticity of the images. Experiments show that our proposed method can effectively complete face swapping and provide high-quality data for deep forgery detection to ensure the security of multimedia systems.

Keywords: biomedical big data; facial anti-spoofing; generative adversarial network; latent feature analysis; multimedia security.

MeSH terms

  • Humans
  • Image Processing, Computer-Assisted* / methods
  • Privacy*