Jack W. Rae
Artificial Intelligence · 2016–2024
A researcher in the Science corpus: 21 papers; trusts 1,011 researchers and is trusted by 380 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 577 citations into it; #1,852 of 36,961 by trust here, #787 by citations
- Computer Vision and Pattern Recognition — 214 citations into it; #3,734 of 21,973 by trust here, #3,607 by citations
- Natural Language Processing — 199 citations into it
- Model Architectures — 153 citations into it; #618 of 2,288 by trust here, #340 by citations
- Large Language Models — 83 citations into it
- Reinforcement Learning — 75 citations into it
- Optimization & Training — 70 citations into it
- Evaluation & Benchmarks — 46 citations into it
Whom Jack W. Rae trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Alex Graves
- Geoffrey E. Hinton
- Yoshua Bengio
- Ilya Sutskever
- Sepp Hochreiter
- Diederik P. Kingma
- Alex Krizhevsky
- J. Urgen Schmidhuber
- Oriol Vinyals
- Yann LeCun
Who trusts Jack W. Rae overall
- Tri Dao
- Yi Tay
- Emilio Parisotto
- Ruslan Salakhutdinov
- Imanol Schlag
- Yoshua Bengio
- Kalpesh Krishna
- J. Urgen Schmidhuber
- Richard He Bai
- Quoc V. Le
Papers from Jack W. Rae's perspective
Ordered by how strongly the researchers Jack W. Rae trusts endorse each paper. Same corpus, a different order for every researcher.
- ImageNet classification with deep convolutional neural networks
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Long Short-Term Memory
- Attention is All you Need (Neural Information Processing Systems)
- Gradient-based learning applied to document recognition
- ImageNet: A large-scale hierarchical image database
- Very Deep Convolutional Networks for Large-Scale Image Recognition (International Conference on Learning Representations)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
- ImageNet Large Scale Visual Recognition Challenge
Their papers
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher (2021) — 1,640 citations
- Training Compute-Optimal Large Language Models (2022) — 3,535 citations
- Improving language models by retrieving from trillions of tokens (2021) — 1,785 citations
- Compressive Transformers for Long-Range Sequence Modelling (2019) — 900 citations
- Relational recurrent neural networks (2018) — 222 citations
- Unsupervised Predictive Memory in a Goal-Directed Agent (2018) — 206 citations
- Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes (2016) — 171 citations
- V-MPO: On-Policy Maximum a Posteriori Policy Optimization for Discrete and Continuous Control (2019) — 141 citations
- Stabilizing Transformers for Reinforcement Learning (2019) — 486 citations
- Reducing Sentiment Bias in Language Models via Counterfactual Evaluation (2019) — 251 citations
- Memory-based Parameter Adaptation (2018) — 106 citations
- Neural Arithmetic Logic Units (2018) — 224 citations
- Training language GANs from Scratch (2019) — 91 citations
- Unified Scaling Laws for Routed Language Models (2022) — 285 citations
- Fast Parametric Learning with Activation Memorization (2018) — 47 citations
- Do Transformers Need Deep Long-Range Memory? (2020) — 45 citations
- Multiplicative Interactions and Where to Find Them (2020) — 160 citations
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context (2024) — 3,818 citations
- An empirical analysis of compute-optimal large language model training (2022) — 516 citations
- Developing Deep Learning Continuous Risk Models for Early Adverse Event Prediction in Electronic Health Records: an AKI Case Study (2019) — 3 citations