Hadi Daneshmand
Artificial Intelligence · 2016–2023
A researcher in the Science corpus: 7 papers; trusts 75 researchers and is trusted by 8 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 117 citations into it; #24,053 of 35,345 by trust here, #17,776 by citations
- Optimization & Training — 80 citations into it; #1,777 of 2,601 by trust here, #1,509 by citations
- Computational Mechanics — 36 citations into it; #4,067 of 10,001 by trust here, #2,715 by citations
- Computer Vision and Pattern Recognition — 36 citations into it
- Model Architectures — 20 citations into it
- Statistical and Nonlinear Physics — 18 citations into it
- Computational Theory and Mathematics — 17 citations into it
- Numerical Analysis — 15 citations into it; #2,032 of 3,586 by trust here, #1,448 by citations
Whom Hadi Daneshmand trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Yurii E. Nesterov
- Zeyuan Allen-Zhu
- Yoshua Bengio
- Geoffrey E. Hinton
- Alex Krizhevsky
- Francis R. Bach
- Diederik P. Kingma
- Kaiming He
- Yann LeCun
- L. Eon Bottou
Who trusts Hadi Daneshmand overall
- Leonard Adolphs
- Jonas Köhler
- Giambattista Parascandolo
- Matthew Staib
- Aurélien Lucchi
- Chi Jin
- Lei Huang
- Waïss Azizian
- Piotr A. Sokól
- Kaiqing Zhang
Papers from Hadi Daneshmand's perspective
Ordered by how strongly the researchers Hadi Daneshmand trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Gradient-based learning applied to document recognition
- Attention is All you Need (Neural Information Processing Systems)
- Long Short-Term Memory
- ImageNet: A large-scale hierarchical image database
- Learning Multiple Layers of Features from Tiny Images
- Very Deep Convolutional Networks for Large-Scale Image Recognition (International Conference on Learning Representations)
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift (International Conference on Machine Learning)
Their papers
- Exponential convergence rates for Batch Normalization: The power of length-direction decoupling in non-convex optimization (2018) — 98 citations
- Escaping Saddles with Stochastic Gradients (2018) — 176 citations
- Transformers learn to implement preconditioned gradient descent for in-context learning (2023) — 311 citations
- Batch normalization provably avoids ranks collapse for randomly initialised deep networks (2020) — 70 citations
- Towards a Theoretical Understanding of Batch Normalization (2018) — 50 citations
- Local Saddle Point Optimization: A Curvature Exploitation Approach (2018) — 115 citations
- Adaptive Newton Method for Empirical Risk Minimization to Statistical Accuracy (2016) — 33 citations