GPT-3: What’s it good for?
By R. Dale. 2020
433 citations recorded by the source corpus.
Abstract GPT-3 made the mainstream media headlines this year, generating far more interest than we’d normally expect of a technical advance in NLP. People are fascinated by its ability to produce apparently novel text that reads as if it was written by a human. But what kind of practical applications can we expect to see, and can they be trusted?
Subfields: Artificial Intelligence, Large Language Models
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Yejin Choi
- Ronan Le Bras
- Maarten Sap
- Daniel Fried
- Noah A. Smith
- Mohit Bansal
- Luke S. Zettlemoyer
- Hannaneh Hajishirzi
In Large Language Models
- Yejin Choi
- Maarten Sap
- Alessandro Lenci
- Shicheng Wan
- Zefeng Chen
- Jiayang Wu
- Wensheng Gan
- Philip S. Yu
Citations in the corpus
- Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs (2022, background): “ever, increasing scrutiny has shed light on the shortcomings of these LLMs, showing that they often fall prey to spurious correlational patterns instead of displaying higher-order reasoning (Elkins and Chun, 2020; Dale, 2021; Marcus, 2022).”
- Large Language Model Alignment: A Survey (2023, background): “, 2023d) that hinders the large-scale deployment of LLMs is their tendency to generate unfaithful or even fabricated content, known as misinformation (Branwen, 2020; Dale, 2021; Rae et al., 2021), hallucination (Lin et al.”
- Understanding Natural Language Understanding Systems. A Critical Analysis (2023, background): “The media attention to current NLUs systems is huge and again unprecedented (Dale 2021).”
- Multimodal Large Language Models: A Survey (2023, methodology): “Pure text LLMs, such as GPT-3 [3], BERT [4], and RoBERTa [5], excel in tasks like text generation and encoding, but they lack a comprehensive understanding and processing of other data types.”
- ChatGPT and a new academic reality: Artificial Intelligence‐written research papers and the ethics of the large language models in scholarly publishing (2023, background): “Generative Pre-Trained Transformer, or GPT, is a language model that understands human inputs (as described with DALL-E above) and then produces response text that is nearly indistinguishable from natural human language (Dale, 2021).”