UniSD: Towards a Unified Self-Distillation Framework for Large Language Models

By Yiqiao Jin, Yi-Yang Wang, Lu-Cheng Fu, Yi-Jia Xiao, Yinyi Luo, Haoxin Liu, B. Prakash, Josiah D. Hester, Jindong Wang, Srijan Kumar. 2026