ScholarBERT: Bigger is Not Always Better

By Zhi Hong, Aswathy Ajith, Gregory Pauloski, Eamon Duede, Carl Malamud, Roger Magoulas, K. Chard, I. Foster. 2022

14 citations recorded by the source corpus.

Subfields: Large Language Models, Natural Language Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Large Language Models

1. Thomas Scialom

In Natural Language Processing

1. Elvis Saravia
2. Guillem Cucurull
3. Thomas Scialom

Citations in the corpus

• Galactica: A Large Language Model for Science (2022, background): “Scientific LanguageModels Works such as SciBERT, BioLM and others have shown the benefit of a curated, scientific corpus (Beltagy et al., 2019; Lewis et al., 2020a; Gu et al., 2020; Lo et al., 2019b; Gu et al., 2020; Shin et al., 2020; Hong et al., 2022).”