Adam Roberts
Artificial Intelligence · 2009–2023
A researcher in the Science corpus: 34 papers; trusts 1,551 researchers and is trusted by 3,571 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 1,180 citations into it; #582 of 36,961 by trust here, #127 by citations
- Natural Language Processing — 612 citations into it; #191 of 5,725 by trust here, #54 by citations
- Computer Vision and Pattern Recognition — 500 citations into it; #1,031 of 21,973 by trust here, #127 by citations
- Large Language Models — 269 citations into it; #20 of 810 by trust here, #15 by citations
- Evaluation & Benchmarks — 218 citations into it
- Safety, Robustness & Interpretability — 149 citations into it
- Generative Models — 145 citations into it; #532 of 1,963 by trust here, #520 by citations
- Model Architectures — 131 citations into it
Whom Adam Roberts trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Diederik P. Kingma
- Geoffrey E. Hinton
- Yoshua Bengio
- Ilya Sutskever
- Alex Krizhevsky
- Noam Shazeer
- Alex Graves
- Kaiming He
- Yann LeCun
- Oriol Vinyals
Who trusts Adam Roberts overall
- Yi Tay
- Akari Asai
- Daniel Khashabi
- Jesse Engel
- Mohit Bansal
- Patrick Lewis
- Barret Zoph
- Timo Schick
- Danqi Chen
- Gautier Izacard
Papers from Adam Roberts's perspective
Ordered by how strongly the researchers Adam Roberts trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Attention is All you Need (Neural Information Processing Systems)
- Long Short-Term Memory
- ImageNet: A large-scale hierarchical image database
- Gradient-based learning applied to document recognition
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
- Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)
Their papers
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (2019) — 26,606 citations
- PaLM: Scaling Language Modeling with Pathways (2022) — 8,214 citations
- Extracting Training Data from Large Language Models (2020) — 3,168 citations
- How Much Knowledge Can You Pack into the Parameters of a Language Model? (2020) — 1,084 citations
- LaMDA: Language Models for Dialog Applications (2022) — 1,891 citations
- Scaling Instruction-Finetuned Language Models (2022) — 4,301 citations
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer (2020) — 3,278 citations
- The Flan Collection: Designing Data and Methods for Effective Instruction Tuning (2023) — 953 citations
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model (2022) — 2,975 citations
- ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models (2021) — 725 citations
- Scaling Up Models and Data with t5x and seqio (2022) — 224 citations
- What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? (2022) — 236 citations
- Do Transformer Modifications Transfer Across Implementations and Applications? (2021) — 138 citations
- Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders (2017) — 781 citations
- WT5?! Training Text-to-Text Models to Explain their Predictions (2020) — 219 citations
- Crosslingual Generalization through Multitask Finetuning (2023) — 602 citations
- Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset (2018) — 596 citations
- GANSynth: Adversarial Neural Audio Synthesis (2019) — 425 citations
- Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models (2017) — 151 citations
- Counterpoint by Convolution (2019) — 166 citations