Noah Constant
Artificial Intelligence · 2018–2022
A researcher in the Science corpus: 20 papers; trusts 1,254 researchers and is trusted by 833 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 669 citations into it; #1,163 of 36,961 by trust here, #797 by citations
- Natural Language Processing — 490 citations into it; #1,249 of 5,725 by trust here, #360 by citations
- Computer Vision and Pattern Recognition — 253 citations into it
- Evaluation & Benchmarks — 156 citations into it
- Large Language Models — 89 citations into it; #71 of 810 by trust here, #120 by citations
- Representation & Self-Supervised Learning — 76 citations into it
- Model Architectures — 70 citations into it
- Efficiency & Compression — 29 citations into it
Whom Noah Constant trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Yoshua Bengio
- Geoffrey E. Hinton
- Diederik P. Kingma
- Ilya Sutskever
- Noam Shazeer
- Alex Krizhevsky
- Alex Graves
- Yann LeCun
- Sepp Hochreiter
- Kaiming He
Who trusts Noah Constant overall
- Yi Tay
- Barret Zoph
- Yi-Lin Sung
- Jianmo Ni
- Tu Vu
- Sebastian Ruder
- Katikapalli Subramanyam Kalyan
- Ankur Bapna
- Xiao Liu
- Mohit Bansal
Papers from Noah Constant's perspective
Ordered by how strongly the researchers Noah Constant trusts endorse each paper. Same corpus, a different order for every researcher.
- Attention is All you Need (Neural Information Processing Systems)
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- ImageNet classification with deep convolutional neural networks
- Long Short-Term Memory
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- ImageNet: A large-scale hierarchical image database
- Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)
- Gradient-based learning applied to document recognition
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
Their papers
- The Power of Scale for Parameter-Efficient Prompt Tuning (2021) — 5,785 citations
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models (2022) — 2,561 citations
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer (2020) — 3,278 citations
- Character-Level Language Modeling with Deeper Self-Attention (2018) — 421 citations
- Universal Sentence Encoder (2018) — 2,093 citations
- ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models (2021) — 725 citations
- Learning Semantic Textual Similarity from Conversations (2018) — 167 citations
- Universal Sentence Encoder for English (2018) — 1,019 citations
- SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer (2021) — 337 citations
- XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation (2021) — 234 citations
- Effective Parallel Corpus Mining using Bilingual Sentence Embeddings (2018) — 115 citations
- Multilingual Universal Sentence Encoder for Semantic Retrieval (2019) — 534 citations
- FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation (2022) — 27 citations
- Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models (2021) — 830 citations
- ReQA: An Evaluation for End-to-End Answer Retrieval Models (2019) — 56 citations
- nmT5 - Is parallel data still relevant for pre-training massively multilingual language models? (2021) — 28 citations
- Overcoming Catastrophic Forgetting in Zero-Shot Cross-Lingual Generation (2022) — 75 citations
- Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution (2021) — 53 citations
- TextSETTR: Label-Free Text Style Extraction and Tunable Targeted Restyling (2021) — 14 citations
- Bridging the Gap for Tokenizer-Free Language Models (2019) — 27 citations