Feature Normalized Knowledge Distillation for Image Classification

125 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Knowledge Distillation: A Survey (2020, background): “…such as the adversarial learning (Liu et al. 2018), auto machine learning (Macko et al. 2019; Fakoor et al. 2020), label noise ﬁltering learning (Xia et al. 2018), lifelong learning (Zhai et al. 2019), and reinforcement learning (Ashok et al. 2018; Xu et al. 2020c; Zhao and Hospedales 2020).”
Collaborative Teacher-Student Learning via Multiple Knowledge Transfer (2021, methodology): “To overcome the limitation of knowledge from the output layer of teacher, the featurebased knowledge from the middle layers of teacher is also used to train the student [21, 18, 19].”