On the Opportunities and Risks of Foundation Models

By Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, R. Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill and 108 more. 2021

6,923 citations recorded by the source corpus.

AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. We call these models foundation models to underscore their critically central yet incomplete character. This report provides a thorough account of the opportunities and risks of foundation models, ranging from their capabilities (e.g., language, vision, robotics, reasoning, human interaction) and technical principles(e.g., model architectures, training procedures, data, systems, security, evaluation, theory) to their applications (e.g., law, healthcare, education) and societal impact (e.g., inequity, misuse, economic and environmental impact, legal and ethical considerations). Though foundation models are based on standard deep learning and transfer learning, their scale results in new emergent capabilities,and their effectiveness across so many tasks incentivizes homogenization. Homogenization provides powerful leverage but demands caution, as the defects of the foundation model are inherited by all the adapted models downstream. Despite the impending widespread deployment of foundation models, we currently lack a clear understanding of how they work, when they fail, and what they are even capable of due to their emergent properties. To tackle these questions, we believe much of the critical research on foundation models will require deep interdisciplinary collaboration commensurate with their fundamentally sociotechnical nature.

Subfields: Artificial Intelligence, Large Language Models, Safety, Robustness & Interpretability

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Percy Liang
  4. Luke S. Zettlemoyer
  5. Yoshua Bengio
  6. Sergey Levine
  7. Quoc V. Le
  8. Yejin Choi

In Large Language Models

  1. Luke S. Zettlemoyer
  2. Yejin Choi
  3. Jianfeng Gao
  4. Hannaneh Hajishirzi
  5. Mohit Bansal
  6. Hinrich Schütze
  7. Noah A. Smith
  8. Quoc V. Le

In Safety, Robustness & Interpretability

  1. Percy Liang
  2. Nicholas Carlini
  3. Matthias Hein
  4. Florian Tramèr
  5. Jacob Steinhardt
  6. Prateek Mittal
  7. Yejin Choi
  8. Nicolas Papernot

Citations in the corpus