EleutherAI: Going Beyond "Open Science" to "Science in the Open"
By Jason Phang, Herbie Bradley, Leo Gao, Louis Castricato, Stella Biderman. 2022
18 citations recorded by the source corpus.
Over the past two years, EleutherAI has established itself as a radically novel initiative aimed at both promoting open-source research and conducting research in a transparent, openly accessible and collaborative manner. EleutherAI's approach to research goes beyond transparency: by doing research entirely in public, anyone in the world can observe and contribute at every stage. Our work has been received positively and has resulted in several high-impact projects in Natural Language Processing and other fields. In this paper, we describe our experience doing public-facing machine learning research, the benefits we believe this approach brings, and the pitfalls we have encountered.
Subfields: Artificial Intelligence, Information Systems and Management, Molecular Biology, Large Language Models, Social Sciences & Humanities
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Luke S. Zettlemoyer
- Mohit Bansal
- Yejin Choi
- Noah A. Smith
- Yonatan Belinkov
- Percy Liang
- Graham Neubig
- Jianfeng Gao
In Information Systems and Management
- Irene Solaiman
- Mohammad Shoeybi
- D. Narayanan
- Benjamin Heinzerling
- Kyle Lo
- Margaret Mitchell
- Canwen Xu
In Molecular Biology
- Kyle Lo
- Iz Beltagy
- Pascale Fung
- Verena Rieser
- Margot Mieskes
- Miruna Clinciu
- Sebastian Gehrmann
- Stella Biderman
In Large Language Models
- Timo Schick
- Colin Raffel
- Pascale Fung
- Luke S. Zettlemoyer
- Douwe Kiela
- Alexander M. Rush
- Niklas Muennighoff
- Yonatan Belinkov
In Social Sciences & Humanities
- Irene Solaiman
- Tristan Thrush
- Verena Rieser
- Douwe Kiela
- Yonatan Belinkov
- Zeerak Talat
- Marine Carpuat
- Maximin Coavoux
Citations in the corpus
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model (2022, background): “Despite the substantial social dangers in allowing this technology to be developed unilaterally by corporations, EleutherAI (Phang et al., 2022) was the only non-corporate entity outside of China that was developing large language models before the BigScience Workshop was convened.”