A Novel Self-Supervised Re-labeling Approach for Training with Noisy Labels

By Devraj Mandal, Shrisha Bharadwaj, Soma Biswas. 2019

29 citations recorded by the source corpus.

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. This is very difficult to obtain and thus has motivated research on training deep neural networks in the presence of label noise. In this work, we build upon the seminal work in this area, Co-teaching and propose a simple, yet efficient approach termed mCT- S2R (modified co-teaching with self-supervision and relabeling) for this task. Firstly, to deal with significant amount of noise in the labels, we propose to use self-supervision to generate robust features without using any labels. Furthermore, using a parallel network architecture, an estimate of the clean labeled portion of the data is obtained. Finally, using this data, a portion of the estimated noisy labeled portion is re-labeled, before resuming the network training with the augmented data. Extensive experiments on three standard datasets show the effectiveness of the proposed framework.

Subfields: Artificial Intelligence, Water Science and Technology

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

Citations in the corpus

Continual Learning on Noisy Data Streams via Self-Purified Replay (2021, background): “Although [56, 47] also use self-supervised learning with noisy labeled data, they focus on the loss or prediction from the model for selecting suspicious samples.”