Sparsity-Accelerated Training for Large Language Models

By Da Ma, Lu Chen, Pengyu Wang, Hong-Shen Xu, Han-Qi Li, Liangtai Sun, Su Zhu, Shuai Fan, Kai Yu. 2024

Subfields: Large Language Models, Efficiency & Compression, Optimization & Training