Noam Shazeer
Artificial Intelligence · 2014–2025
A researcher in the Science corpus: 38 papers; trusts 2,197 researchers and is trusted by 15,544 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 1,217 citations into it; #55 of 36,961 by trust here, #17 by citations
- Computer Vision and Pattern Recognition — 573 citations into it; #512 of 21,973 by trust here, #86 by citations
- Natural Language Processing — 560 citations into it; #25 of 5,725 by trust here, #3 by citations
- Model Architectures — 245 citations into it; #27 of 2,288 by trust here, #11 by citations
- Large Language Models — 195 citations into it; #11 of 810 by trust here, #19 by citations
- Evaluation & Benchmarks — 171 citations into it
- Optimization & Training — 139 citations into it; #188 of 2,605 by trust here, #448 by citations
- Efficiency & Compression — 117 citations into it; #23 of 1,273 by trust here, #22 by citations
Whom Noam Shazeer trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Geoffrey E. Hinton
- Yoshua Bengio
- Diederik P. Kingma
- Ilya Sutskever
- Alex Krizhevsky
- Ashish Vaswani
- Alex Graves
- Kaiming He
- Tomas Mikolov
- Jimmy Ba
Who trusts Noam Shazeer overall
- Yi Tay
- Mohit Bansal
- Quoc V. Le
- Yoshua Bengio
- Barret Zoph
- Mostafa Dehghani
- Zhe Gan
- Jianfeng Gao
- Percy Liang
- Irwan Bello
Papers from Noam Shazeer's perspective
Ordered by how strongly the researchers Noam Shazeer trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Attention is All you Need (Neural Information Processing Systems)
- Long Short-Term Memory
- ImageNet: A large-scale hierarchical image database
- Gradient-based learning applied to document recognition
- Very Deep Convolutional Networks for Large-Scale Image Recognition (International Conference on Learning Representations)
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
Their papers
- Attention is All you Need (2017) — 185,508 citations
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (2019) — 26,606 citations
- PaLM: Scaling Language Modeling with Pathways (2022) — 8,214 citations
- Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks (2015) — 2,414 citations
- Exploring the Limits of Language Modeling (2016) — 1,188 citations
- Image Transformer (2018) — 1,925 citations
- Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer (2017) — 5,113 citations
- Adafactor: Adaptive Learning Rates with Sublinear Memory Cost (2018) — 1,323 citations
- Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity (2021) — 4,336 citations
- How Much Knowledge Can You Pack into the Parameters of a Language Model? (2020) — 1,084 citations
- Generating Wikipedia by Summarizing Long Sequences (2018) — 875 citations
- LaMDA: Language Models for Dialog Applications (2022) — 1,891 citations
- GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding (2020) — 2,182 citations
- Tensor2Tensor for Neural Machine Translation (2018) — 553 citations
- GLU Variants Improve Transformer (2020) — 2,062 citations
- One Model To Learn Them All (2017) — 350 citations
- Fast Transformer Decoding: One Write-Head is All You Need (2019) — 825 citations
- Scaling Up Models and Data with t5x and seqio (2022) — 224 citations
- Mesh-TensorFlow: Deep Learning for Supercomputers (2018) — 439 citations
- GSPMD: General and Scalable Parallelization for ML Computation Graphs (2021) — 188 citations