Large Language Models
By Michael R Douglas. 2023
1,205 citations recorded by the source corpus.
Large Language ModelsIn the latest edition of Stats, STAT!, Fralick and colleagues explain the statistics behind large language models - used in chat bots like ChatGPT and Bard. While these new tools may seem remarkably intelligent, at their core they just assemble sentences based on statistics from large amounts of text.
Subfields: Artificial Intelligence, General Social Sciences, Information Systems, Large Language Models
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Mohit Bansal
- Percy Liang
- Jianfeng Gao
- Sergey Levine
- Yoshua Bengio
- Kyunghyun Cho
- Quoc V. Le
- Luke S. Zettlemoyer
In General Social Sciences
- Noah D. Goodman
- Karthik Narasimhan
- Yuan Cao
- Bartosz Piotrowski
- Edward W. Ayers
- Jeremy Avigad
- Qun Liu
- T. Griffiths
In Information Systems
- Noah D. Goodman
- Karthik Narasimhan
- David Krueger
- Bartosz Piotrowski
- Edward W. Ayers
- Mantas Mazeika
- Jeremy Avigad
- Qun Liu
In Large Language Models
Citations in the corpus
- Detecting Language Model Attacks with Perplexity (2023, background): “It is proposed in [Zou et al. 2023] that (GCG) could be further improved by taking ARCA [Jones et al. 2023] and pursuing a similar all-coordinates strategy.”
- Reasoning with Language Model Prompting: A Survey (2022, neutral): “, 2023b), Table (Chen, 2022), AlgoPrompt (Zhou et al.”
- ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematics (2023, methodology): “A blessing and a curse of current language models is that few-shot learning performance is highly sensitive to the exact prompt that is used [Kojima et al., 2022].”
- ULTRAFEEDBACK: Boosting Language Models with Scaled AI Feedback (2023, neutral): “…quality of critique based on detailed documentation. we follow (Wang et al., 2023c) to randomly sample 50 instructions from PIQA (Bisk et al., 2020), OpenBookQA (OBQA) (Mihaylov et al., 2018), CommonsenseQA (Talmor et al., 2018), AlpacaFarm (Dubois et al., 2023), and FairEval (Wang et al., 2023b).”
- Tree of Thoughts: Deliberate Problem Solving with Large Language Models (2023, background): “See concrete examples of how thoughts are generated, evaluated, and searched in Figures 2,4,6. choices instead of just picking one, and (2) evaluates its current status and actively looks ahead or backtracks to make more global decisions.”
- The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning (2024, background): “…et al., 2020; Rafailov et al., 2023) have been developed; however, these methods can be vulnerable to jailbreaks (Wei et al., 2023; Chao et al., 2023; Yao et al., 2023a; Yuan et al., 2023) and adversarial attacks (Wallace et al., 2019; Guo et al., 2021; Jones et al., 2023; Zou et al., 2023b).”
- AgentTuning: Enabling Generalized Agent Abilities for LLMs (2023, neutral): “This process was entirely automated using”
- The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A" (2023, methodology): “2023) perform entity-linking on the pretraining datasets of GPT-J and Bloom (Wang & Komatsuzaki, 2021; Workshop et al., 2023) to find all the occurrences of an entity in the pretraining data.”
- Quiet-STaR: Language Models Can Teach Themselves to Think Before Speaking (2024, methodology): “…(2021) demonstrated that “scratchpads” required less scaffolding when the language models were more capable, a result later reinforced by Wei et al. (2022b), emphasizing informal tasks, and further strengthened by Kojima et al. (2022), demonstrating this behavior could be accomplished zero-shot.”
- Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback (2023, methodology): “See also Wang et al. [2023] for a survey of methods for aligning LLMs.”
- Long Context Transfer from Language to Vision (2024, neutral): “5 4K ST-LLM [49] 256 16 Vicuna-1.”
- 3D-VLA: A 3D Vision-Language-Action Generative World Model (2024, neutral): “3D Foundation Models Our paper is closely related to the 3D foundation models that integrate 3D features in MLLMs (Hong et al., 2023; Chen et al., 2023b; Qi et al., 2023; Xu et al., 2023; Huang et al., 2023a; Zhou et al., 2023; Guo et al., 2023; Li et al., 2024).”
- Aligning Large Language Models with Human: A Survey (2023, background): “(2023), code generation (Zhuo, 2023), open-ended QA (Bai et al.”