J. Ainslie
Artificial Intelligence · 2020–2023
A researcher in the Science corpus: 11 papers; trusts 473 researchers and is trusted by 10 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 355 citations into it; #15,424 of 35,345 by trust here, #2,929 by citations
- Computer Vision and Pattern Recognition — 204 citations into it
- Natural Language Processing — 167 citations into it; #4,424 of 5,688 by trust here, #2,333 by citations
- Model Architectures — 136 citations into it; #1,129 of 2,278 by trust here, #329 by citations
- Large Language Models — 108 citations into it; #480 of 799 by trust here, #665 by citations
- Efficiency & Compression — 73 citations into it; #858 of 1,264 by trust here, #950 by citations
- Evaluation & Benchmarks — 53 citations into it
- Information Retrieval & Search — 26 citations into it
Whom J. Ainslie trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Geoffrey E. Hinton
- Noam Shazeer
- Yoshua Bengio
- Ashish Vaswani
- Diederik P. Kingma
- Ilya Sutskever
- Alex Krizhevsky
- Kaiming He
- Jacob Devlin
- Yann LeCun
Who trusts J. Ainslie overall
- Yi Tay
- James Lee-Thorp
- Mostafa Dehghani
- Ruining He
- Huiyu Wang
- Jianwei Yang
- Tri Dao
- Dara Bahri
- Izzeddin Gur
- William Fedus
Papers from J. Ainslie's perspective
Ordered by how strongly the researchers J. Ainslie trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Attention is All you Need (Neural Information Processing Systems)
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Long Short-Term Memory
- ImageNet: A large-scale hierarchical image database
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- Gradient-based learning applied to document recognition
- Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
Their papers
- Big Bird: Transformers for Longer Sequences (2020) — 2,963 citations
- GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints (2023) — 1,604 citations
- ETC: Encoding Long and Structured Data in Transformers (2020) — 58 citations
- ETC: Encoding Long and Structured Inputs in Transformers (2020) — 415 citations
- FNet: Mixing Tokens with Fourier Transforms (2021) — 751 citations
- LongT5: Efficient Text-To-Text Transformer for Long Sequences (2021) — 414 citations
- Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints (2022) — 215 citations
- Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT (2022) — 15 citations
- FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference (2022) — 44 citations
- ReadTwice: Reading Very Large Documents with Memories (2021) — 18 citations
- RealFormer: Transformer Likes Residual Attention (2020) — 138 citations