Supplementary Material: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers

By Wenhui Wang, Furu Wei, Li Dong, Nan Yang, Ming Zhou. 2020

Subfields: Model Architectures, Efficiency & Compression