Joel Hestness
Artificial Intelligence · 2011–2023
A researcher in the Science corpus: 8 papers; trusts 184 researchers and is trusted by 3 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 120 citations into it; #34,917 of 35,345 by trust here, #7,346 by citations
- Computer Vision and Pattern Recognition — 70 citations into it
- Optimization & Training — 47 citations into it
- Natural Language Processing — 40 citations into it; #5,151 of 5,688 by trust here, #4,539 by citations
- Model Architectures — 29 citations into it
- Scaling & Learning Theory — 26 citations into it; #425 of 428 by trust here, #173 by citations
- Evaluation & Benchmarks — 18 citations into it
- Hardware and Architecture — 18 citations into it
Whom Joel Hestness trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Kaiming He
- Alex Krizhevsky
- Geoffrey E. Hinton
- Yoshua Bengio
- Shun-ichi Amari
- Ilya Sutskever
- Oriol Vinyals
- Alex Graves
- Diederik P. Kingma
- Yann LeCun
Who trusts Joel Hestness overall
- Aran Komatsuzaki
- Asit K. Mishra
- Jared Kaplan
- N. Ahmed
- Ibrahim M. Alabdulmohsin
- Alec Radford
- Mark Johnson
- J. Latorre
- Samuel R. Bowman
- Jared Kaplan
Papers from Joel Hestness's perspective
Ordered by how strongly the researchers Joel Hestness trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Long Short-Term Memory
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Attention is All you Need (Neural Information Processing Systems)
- ImageNet: A large-scale hierarchical image database
- Gradient-based learning applied to document recognition
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift (International Conference on Machine Learning)
- Very Deep Convolutional Networks for Large-Scale Image Recognition (International Conference on Learning Representations)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
Their papers
- Deep Learning Scaling is Predictable, Empirically (2017) — 1,031 citations
- Beyond human-level accuracy: computational challenges in deep learning (2019) — 87 citations
- Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster (2023) — 141 citations
- Pipelined Backpropagation at Scale: Training Large Models without Batches (2020) — 39 citations
- Time and the Value of Data (2020) — 21 citations
- Compositional Generalization for Primitive Substitutions (2019) — 89 citations
- Empirically Characterizing Overparameterization Impact on Convergence (2018) — 4 citations
- The gem5 simulator (2011) — 5,271 citations