Exploring Temporal Coherence for More General Video Face Forgery Detection

By Yinglin Zheng, Jianmin Bao, Dong Chen, Ming Zeng, Fang Wen. IEEE International Conference on Computer Vision, 2021

344 citations recorded by the source corpus.

Although current face manipulation techniques achieve impressive performance regarding quality and controllability, they are struggling to generate temporal coherent face videos. In this work, we explore to take full advantage of the temporal coherence for video face forgery detection. To achieve this, we propose a novel end-to-end framework, which consists of two major stages. The first stage is a fully temporal convolution network (FTCN). The key insight of FTCN is to reduce the spatial convolution kernel size to 1, while maintaining the temporal convolution kernel size un-changed. We surprisingly find this special design can benefit the model for extracting the temporal features as well as improve the generalization capability. The second stage is a Temporal Transformer network, which aims to explore the long-term temporal coherence. The proposed frame-work is general and flexible, which can be directly trained from scratch without any pre-training models or external datasets. Extensive experiments show that our framework outperforms existing methods and remains effective when applied to detect new sorts of face forgery videos.

Subfields: Computer Vision and Pattern Recognition

View Paper: https://www.semanticscholar.org/paper/1fdf904230ab4dabaa1f8f09c2549dcf61ee1bc1

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Baoyuan Wu
  2. Toshihiko Yamasaki
  3. Zhiyuan Yan
  4. Kaede Shiohara
  5. Yanbo Fan
  6. Yong Zhang

Citations in the corpus