The Price of Prompting: Profiling Energy Use in Large Language Models Inference

By E. J. Husom, Arda Goknil, L. K. Shar, Sagar Sen. 2024

Subfields: Large Language Models, Efficiency & Compression, ML Systems & Hardware