GPT-4 Technical Report

By OpenAI Josh Achiam, OpenAI, Steven Adler, Josh Achiam, S. Agarwal, L. Ahmad, Ilge Akkaya, Florencia Leoni Aleman, D. Almeida, Janko Altenschmidt and 281 more. 2023

26,133 citations recorded by the source corpus.

We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.

Subfields: Artificial Intelligence, Computer Vision and Pattern Recognition, Large Language Models

View Paper: https://arxiv.org/abs/2303.08774

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Sergey Levine
  4. Percy Liang
  5. Yoshua Bengio
  6. Luke S. Zettlemoyer
  7. Quoc V. Le
  8. Yejin Choi

In Computer Vision and Pattern Recognition

  1. Luc Van Gool
  2. Dacheng Tao
  3. Trevor Darrell
  4. Xiaogang Wang
  5. Ming-Hsuan Yang
  6. Jitendra Malik
  7. Andrew Zisserman
  8. Yi Yang

In Large Language Models

  1. Luke S. Zettlemoyer
  2. Yejin Choi
  3. Hinrich Schütze
  4. Noah A. Smith
  5. Jianfeng Gao
  6. Mohit Bansal
  7. Furu Wei
  8. Timo Schick

Citations in the corpus