Shaohan Huang

Artificial Intelligence · 2017–2024

A researcher in the Science corpus: 20 papers; trusts 784 researchers and is trusted by 10 researchers here, as inferred from the citation graph.

Subfields

• Artificial Intelligence — 571 citations into it; #13,494 of 35,345 by trust here, #2,774 by citations
• Natural Language Processing — 339 citations into it; #3,967 of 5,688 by trust here, #2,156 by citations
• Computer Vision and Pattern Recognition — 315 citations into it; #12,946 of 21,575 by trust here, #2,625 by citations
• Large Language Models — 173 citations into it; #512 of 799 by trust here, #423 by citations
• Evaluation & Benchmarks — 157 citations into it
• Multimodal Learning — 92 citations into it
• Model Architectures — 90 citations into it; #1,566 of 2,278 by trust here, #999 by citations
• Efficiency & Compression — 49 citations into it

Whom Shaohan Huang trusts overall

Their strongest outbound trust, strongest first, inferred from their citations.

1. Diederik P. Kingma
2. Geoffrey E. Hinton
3. Yoshua Bengio
4. Ilya Sutskever
5. Kaiming He
6. Alex Krizhevsky
7. Jimmy Ba
8. Yann LeCun
9. Oriol Vinyals
10. Alex Graves

Who trusts Shaohan Huang overall

1. Li Dong
2. Shuming Ma
3. Wenhui Wang
4. Runsen Xu
5. Yuan Hu
6. Hang Zhang
7. D'idac Sur'is
8. Haotian Liu
9. Zhiliang Peng
10. Yaru Hao

Papers from Shaohan Huang's perspective

Ordered by how strongly the researchers Shaohan Huang trusts endorse each paper. Same corpus, a different order for every researcher.

1. Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
2. ImageNet classification with deep convolutional neural networks
3. Attention is All you Need (Neural Information Processing Systems)
4. Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
5. Long Short-Term Memory
6. ImageNet: A large-scale hierarchical image database
7. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
8. Gradient-based learning applied to document recognition
9. Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
10. Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)

Their papers

• Language Is Not All You Need: Aligning Perception with Language Models (2023) — 786 citations
• Kosmos-2: Grounding Multimodal Large Language Models to the World (2023) — 1,249 citations
• Language Models are General-Purpose Interfaces (2022) — 113 citations
• LayoutLM: Pre-training of Text and Layout for Document Image Understanding (2019) — 1,049 citations
• Response Generation by Context-aware Prototype Editing (2018) — 128 citations
• Neural Document Summarization by Jointly Learning to Score and Select Sentences (2018) — 346 citations
• MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers (2020) — 413 citations
• On the Representation Collapse of Sparse Mixture of Experts (2022) — 199 citations
• DeepNet: Scaling Transformers to 1,000 Layers (2022) — 261 citations
• Language Generation with Multi-hop Reasoning on Commonsense Knowledge Graph (2020) — 120 citations
• Kformer: Knowledge Injection in Transformer Feed-Forward Layers (2022) — 52 citations
• Foundation Transformers (2022) — 30 citations
• DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders (2021) — 92 citations
• LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens (2023) — 265 citations
• A Length-Extrapolatable Transformer (2022) — 176 citations
• The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits (2024) — 424 citations
• Retentive Network: A Successor to Transformer for Large Language Models (2023) — 719 citations
• TorchScale: Transformers at Scale (2022) — 12 citations
• XLM-E: Cross-lingual Language Model Pre-training via ELECTRA (2021) — 139 citations
• SuperAgent: A Customer Service Chatbot for E-commerce Websites (2017) — 320 citations