Manu Romero

Natural Language Processing · 2022

A researcher in the Science corpus: 1 paper; trusts 2 researchers and is trusted by 0 researchers here, as inferred from the citation graph.

Subfields

• Natural Language Processing — 16 citations into it
• Large Language Models — 13 citations into it

Whom Manu Romero trusts

Their strongest outbound trust, strongest first, inferred from their citations.

1. Kenneth Heafield (in Natural Language Processing)
2. Alec Radford (in Large Language Models)

Papers from Manu Romero's perspective

Ordered by how strongly the researchers Manu Romero trusts endorse each paper. Same corpus, a different order for every researcher.

1. Attention is All you Need (Neural Information Processing Systems)
2. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
3. Language Models are Unsupervised Multitask Learners
4. Improving Language Understanding by Generative Pre-Training
5. RoBERTa: A Robustly Optimized BERT Pretraining Approach (arXiv.org)
6. Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity (Journal of machine learning research)
7. On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
8. The Pile: An 800GB Dataset of Diverse Text for Language Modeling
9. I and J
10. Unsupervised Machine Translation Using Monolingual Corpora Only

Their papers

• BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Sampling (2022) — 113 citations