Pengcheng He
Artificial Intelligence · 2019–2023
A researcher in the Science corpus: 22 papers; trusts 1,687 researchers and is trusted by 852 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 700 citations into it; #1,229 of 36,961 by trust here, #1,346 by citations
- Natural Language Processing — 419 citations into it; #666 of 5,725 by trust here, #783 by citations
- Computer Vision and Pattern Recognition — 304 citations into it; #2,817 of 21,973 by trust here, #1,483 by citations
- Evaluation & Benchmarks — 165 citations into it
- Large Language Models — 165 citations into it; #115 of 810 by trust here, #263 by citations
- Information Retrieval & Search — 55 citations into it
- Representation & Self-Supervised Learning — 53 citations into it
- Optimization & Training — 52 citations into it; #1,510 of 2,605 by trust here, #525 by citations
Whom Pengcheng He trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Diederik P. Kingma
- Geoffrey E. Hinton
- Yoshua Bengio
- Alex Krizhevsky
- Ilya Sutskever
- Jimmy Ba
- Xiaodong Liu
- Kaiming He
- Yann LeCun
- Alec Radford
Who trusts Pengcheng He overall
- Xiaodong Liu
- Jianfeng Gao
- Samuel R. Bowman
- Weizhu Chen
- Zhe Gan
- Xi Ye
- Qingru Zhang
- Ronghang Hu
- Jonathan Pilault
- Abhilasha Ravichander
Papers from Pengcheng He's perspective
Ordered by how strongly the researchers Pengcheng He trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- ImageNet classification with deep convolutional neural networks
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Attention is All you Need (Neural Information Processing Systems)
- Long Short-Term Memory
- ImageNet: A large-scale hierarchical image database
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- Gradient-based learning applied to document recognition
- Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
Their papers
- Multi-Task Deep Neural Networks for Natural Language Understanding (2019) — 1,357 citations
- DeBERTa: Decoding-enhanced BERT with Disentangled Attention (2020) — 3,946 citations
- On the Variance of the Adaptive Learning Rate and Beyond (2019) — 2,272 citations
- Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding (2019) — 192 citations
- Instruction Tuning with GPT-4 (2023) — 837 citations
- SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization (2019) — 613 citations
- Generation-Augmented Retrieval for Open-Domain Question Answering (2020) — 323 citations
- DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing (2021) — 1,986 citations
- Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback (2023) — 530 citations
- Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention (2021) — 64 citations
- Diffusion-GAN: Training GANs with Diffusion (2022) — 343 citations
- Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning (2020) — 72 citations
- The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding (2020) — 62 citations
- Adversarial Training for Large Neural Language Models (2020) — 206 citations
- X-SQL: reinforce schema representation with context (2019) — 103 citations
- GODEL: Large-Scale Pre-Training for Goal-Directed Dialog (2022) — 80 citations
- A Hybrid Neural Network Model for Commonsense Reasoning (2019) — 30 citations
- UnitedQA: A Hybrid Approach for Open Domain Question Answering (2021) — 65 citations
- Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (2023) — 729 citations
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (2023) — 404 citations