Residual Distillation: Towards Portable Deep Neural Networks without Shortcuts

By Guilin Li, Junlei Zhang, Yunhe Wang, Chuanjian Liu, Matthias Hwai Yong Tan, Yunfeng Lin, Wei Zhang, Jiashi Feng, Tong Zhang. 2020

36 citations recorded by the source corpus.

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

1. Jianping Gou
2. Dacheng Tao
3. Baosheng Yu
4. S. Maybank
5. Changxing Ding
6. Chao-qun Hong
7. Jing Zhang
8. Jun Yu

Citations in the corpus

• Knowledge Distillation: A Survey (2020, methodology): “…including the design of knowledge (Hinton et al. 2015; Romero et al. 2015) and the loss functions for matching features or distributions matching (Huang and Wang 2017; Passalis and Tefas 2018; Zagoruyko and Komodakis 2017; Mirzadeh et al. 2020; Li et al. 2020d; Heo et al. 2019b; Asif et al. 2020).”