Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback

By Baolin Peng, Michel Galley, Pengcheng He, Hao Cheng, Yujia Xie, Qiuyuan Huang, Lars Lidén, Zhou Yu, Weizhu Chen, Jianfeng Gao. 2023

530 citations recorded by the source corpus.

Large language models (LLMs), such as ChatGPT, are able to generate human-like, fluent responses for many downstream tasks, e.g., task-oriented dialog and question answering. However, applying LLMs to real-world, mission-critical applications remains challenging mainly due to their tendency to generate hallucinations and their inability to use external knowledge. This paper proposes a LLM-Augmenter system, which augments a black-box LLM with a set of plug-and-play modules. Our system makes the LLM generate responses grounded in external knowledge, e.g., stored in task-specific databases. It also iteratively revises LLM prompts to improve model responses using feedback generated by utility functions, e.g., the factuality score of a LLM-generated response. The effectiveness of LLM-Augmenter is empirically validated on two types of scenarios, task-oriented dialog and open-domain question answering. LLM-Augmenter significantly reduces ChatGPT's hallucinations without sacrificing the fluency and informativeness of its responses. We make the source code and models publicly available.

Subfields: Artificial Intelligence, Health Informatics, Retrieval-Augmented Generation, Large Language Models

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Jianfeng Gao
  2. Mohit Bansal
  3. Percy Liang
  4. Luke S. Zettlemoyer
  5. Yejin Choi
  6. Noah A. Smith
  7. Graham Neubig
  8. Quoc V. Le

In Health Informatics

  1. Amit P. Sheth
  2. Amitava Das
  3. Vipula Rawte
  4. Alexander J. Ratner
  5. Noah A. Smith
  6. Song-Chun Zhu
  7. Niket Tandon
  8. Sarah Wiegreffe

In Retrieval-Augmented Generation

  1. Luyu Gao
  2. Ji-rong Wen
  3. Wayne Xin Zhao
  4. Jianfeng Gao
  5. Michel Galley
  6. Mojtaba Komeili
  7. Noah A. Smith
  8. Ranjay Krishna

In Large Language Models

  1. Jianfeng Gao
  2. Weizhu Chen
  3. Pengcheng He
  4. Yu Meng
  5. Nan Duan
  6. Noah A. Smith
  7. Ji-rong Wen
  8. Wayne Xin Zhao

Citations in the corpus