Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

By Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso and 448 more. 2023

266 citations recorded by the source corpus.

Subfields: Large Language Models, Evaluation & Benchmarks

Citations in the corpus

• Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks (2022, neutral): “B ENCH (Srivastava et al., 2022) introduces a collection of 204 tasks and also provides short task descriptions and input prefixes that can be used for prompting LMs.”
• Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools (2024, unknown): “The Practical Law documents cited are named in square brackets.”