Yi Tay
Artificial Intelligence · Journal of machine learning research · 2017–2024
A researcher in the Science corpus: 53 papers; trusts 2,960 researchers and is trusted by 566 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 2,489 citations into it; #1,905 of 36,961 by trust here, #341 by citations
- Natural Language Processing — 1,125 citations into it; #2,206 of 5,725 by trust here, #1,110 by citations
- Computer Vision and Pattern Recognition — 1,116 citations into it; #2,614 of 21,973 by trust here, #490 by citations
- Large Language Models — 526 citations into it; #683 of 810 by trust here, #75 by citations
- Evaluation & Benchmarks — 491 citations into it
- Model Architectures — 386 citations into it; #514 of 2,288 by trust here, #267 by citations
- Information Systems — 307 citations into it; #1,234 of 9,233 by trust here, #1,054 by citations
- Efficiency & Compression — 216 citations into it
Whom Yi Tay trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Diederik P. Kingma
- Noam Shazeer
- Ilya Sutskever
- Geoffrey E. Hinton
- Alex Krizhevsky
- Yoshua Bengio
- Kaiming He
- Alex Graves
- Richard Socher
- Oriol Vinyals
Who trusts Yi Tay overall
- Mostafa Dehghani
- James Lee-Thorp
- Dara Bahri
- Donald Metzler
- Xiangnan He
- Salman Hameed Khan
- J. Ainslie
- Aminu Da’u
- Andrew Jaegle
- Guanghui Qin
Papers from Yi Tay's perspective
Ordered by how strongly the researchers Yi Tay trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Attention is All you Need (Neural Information Processing Systems)
- Long Short-Term Memory
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- ImageNet: A large-scale hierarchical image database
- Gradient-based learning applied to document recognition
- Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
Their papers
- PaLM: Scaling Language Modeling with Pathways (2022) — 8,214 citations
- Scaling Instruction-Finetuned Language Models (2022) — 4,301 citations
- Emergent Abilities of Large Language Models (2022) — 3,700 citations
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them (2022) — 2,044 citations
- PaLM 2 Technical Report (2023) — 1,524 citations
- Efficient Transformers: A Survey (2020) — 1,579 citations
- Scaling Vision Transformers to 22 Billion Parameters (2023) — 911 citations
- The Flan Collection: Designing Data and Methods for Effective Instruction Tuning (2023) — 953 citations
- Synthesizer: Rethinking Self-Attention for Transformer Models (2020) — 407 citations
- Long Range Arena: A Benchmark for Efficient Transformers (2020) — 917 citations
- Language Models are Multilingual Chain-of-Thought Reasoners (2022) — 634 citations
- UL2: Unifying Language Learning Paradigms (2022) — 395 citations
- ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning (2021) — 240 citations
- Do Transformer Modifications Transfer Across Implementations and Applications? (2021) — 138 citations
- Sparse Sinkhorn Attention (2020) — 399 citations
- Transcending Scaling Laws with 0.1% Extra Compute (2022) — 78 citations
- SCENIC: A JAX Library for Computer Vision Research and Beyond (2021) — 78 citations
- Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers (2021) — 152 citations
- The Benchmark Lottery (2021) — 147 citations
- Charformer: Fast Character Transformers via Gradient-based Subword Tokenization (2021) — 213 citations