Oren Pereg

Representation & Self-Supervised Learning · 2022

A researcher in the Science corpus: 1 paper; trusts 1 researcher and is trusted by 0 researchers here, as inferred from the citation graph.

Subfields

• Representation & Self-Supervised Learning — 8 citations into it

Whom Oren Pereg trusts

Their strongest outbound trust, strongest first, inferred from their citations.

1. Gregory R. Koch (in Representation & Self-Supervised Learning)

Papers from Oren Pereg's perspective

Ordered by how strongly the researchers Oren Pereg trusts endorse each paper. Same corpus, a different order for every researcher.

1. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
2. Distilling the Knowledge in a Neural Network (arXiv.org)
3. RoBERTa: A Robustly Optimized BERT Pretraining Approach (arXiv.org)
4. Scaling Laws for Neural Language Models (arXiv.org)
5. Siamese Neural Networks for One-Shot Image Recognition
6. Parameter-Efficient Transfer Learning for NLP
7. Do Deep Nets Really Need to be Deep?
8. SentEval: An Evaluation Toolkit for Universal Sentence Representations
9. Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping
10. Learning multiple visual domains with residual adapters

Their papers

• Efficient Few-Shot Learning Without Prompts (2022) — 311 citations