Rami Al-Rfou
Artificial Intelligence · 2013–2022
A researcher in the Science corpus: 19 papers; trusts 1,441 researchers and is trusted by 1,963 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 662 citations into it; #644 of 36,961 by trust here, #539 by citations
- Natural Language Processing — 396 citations into it; #692 of 5,725 by trust here, #469 by citations
- Computer Vision and Pattern Recognition — 258 citations into it; #21,923 of 21,973 by trust here, #9,217 by citations
- Evaluation & Benchmarks — 102 citations into it; #3,153 of 3,155 by trust here, #2,750 by citations
- Model Architectures — 98 citations into it
- Large Language Models — 90 citations into it; #64 of 810 by trust here, #158 by citations
- Representation & Self-Supervised Learning — 75 citations into it; #130 of 3,156 by trust here, #230 by citations
- Information Systems — 37 citations into it
Whom Rami Al-Rfou trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Yoshua Bengio
- Geoffrey E. Hinton
- L. Eon Bottou
- Ilya Sutskever
- Diederik P. Kingma
- Alex Krizhevsky
- Tomas Mikolov
- Alex Graves
- Sepp Hochreiter
- Yann LeCun
Who trusts Rami Al-Rfou overall
- Bryan Perozzi
- Yoshua Bengio
- Zhilin Yang
- Mohit Bansal
- Ruslan Salakhutdinov
- André F. T. Martins
- William L. Hamilton
- Yi Tay
- Barbara Plank
- Percy Liang
Papers from Rami Al-Rfou's perspective
Ordered by how strongly the researchers Rami Al-Rfou trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Attention is All you Need (Neural Information Processing Systems)
- Long Short-Term Memory
- ImageNet: A large-scale hierarchical image database
- Gradient-based learning applied to document recognition
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- Very Deep Convolutional Networks for Large-Scale Image Recognition (International Conference on Learning Representations)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
Their papers
- The Power of Scale for Parameter-Efficient Prompt Tuning (2021) — 5,785 citations
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer (2020) — 3,278 citations
- Theano: A Python framework for fast computation of mathematical expressions (2016) — 2,380 citations
- Character-Level Language Modeling with Deeper Self-Attention (2018) — 421 citations
- DeepWalk: online learning of social representations (2014) — 10,831 citations
- ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models (2021) — 725 citations
- Polyglot: Distributed Word Representations for Multilingual NLP (2013) — 496 citations
- Wiki-40B: Multilingual Language Model Dataset (2020) — 139 citations
- SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer (2021) — 337 citations
- Efficient Natural Language Response Suggestion for Smart Reply (2017) — 514 citations
- Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training (2021) — 208 citations
- Conversational Contextual Cues: The Case of Personalization and History for Response Ranking (2016) — 93 citations
- Statistically Significant Detection of Linguistic Change (2014) — 502 citations
- Wayformer: Motion Forecasting via Simple & Efficient Attention Networks (2022) — 449 citations
- A Growing Long-term Episodic & Semantic Memory (2016) — 10 citations
- nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? (2021) — 28 citations
- Large Scale Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training (2020) — 36 citations
- Bridging the Gap for Tokenizer-Free Language Models (2019) — 27 citations
- Watch Your Step: Learning Node Embeddings via Graph Attention (2017) — 207 citations