Llama 2: Open Foundation and Fine-Tuned Chat Models

By Hugo Touvron, Louis Martin, Kevin R. Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Niko-lay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale and 64 more. arXiv.org, 2023

17,670 citations recorded by the source corpus.

In this work, we develop and release Llama 2, a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Our fine-tuned LLMs, called Llama 2-Chat, are optimized for dialogue use cases. Our models outperform open-source chat models on most benchmarks we tested, and based on our human evaluations for helpfulness and safety, may be a suitable substitute for closed-source models. We provide a detailed description of our approach to fine-tuning and safety improvements of Llama 2-Chat in order to enable the community to build on our work and contribute to the responsible development of LLMs.

Subfields: Artificial Intelligence, Large Language Models, Alignment & RLHF

View Paper: https://arxiv.org/abs/2307.09288

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Luke S. Zettlemoyer
  4. Percy Liang
  5. Yejin Choi
  6. Yoshua Bengio
  7. Quoc V. Le
  8. Graham Neubig

In Large Language Models

  1. Luke S. Zettlemoyer
  2. Yejin Choi
  3. Noah A. Smith
  4. Furu Wei
  5. Jianfeng Gao
  6. Hannaneh Hajishirzi
  7. Hinrich Schütze
  8. Graham Neubig

In Alignment & RLHF

  1. Jianfeng Gao
  2. Yejin Choi
  3. Rafael Rafailov
  4. Dylan Hadfield-Menell
  5. Xinyun Chen
  6. Mari Ostendorf
  7. Noah A. Smith
  8. David Krueger

Citations in the corpus