Iz Beltagy
Artificial Intelligence · 2018–2023
A researcher in the Science corpus: 17 papers; trusts 1,282 researchers and is trusted by 619 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 734 citations into it; #1,346 of 36,961 by trust here, #982 by citations
- Natural Language Processing — 447 citations into it; #830 of 5,725 by trust here, #978 by citations
- Computer Vision and Pattern Recognition — 211 citations into it
- Evaluation & Benchmarks — 188 citations into it; #2,365 of 3,155 by trust here, #1,610 by citations
- Large Language Models — 186 citations into it; #39 of 810 by trust here, #109 by citations
- Molecular Biology — 76 citations into it; #688 of 17,836 by trust here, #3,409 by citations
- Model Architectures — 66 citations into it; #253 of 2,288 by trust here, #383 by citations
- Prompting & Reasoning — 53 citations into it
Whom Iz Beltagy trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Diederik P. Kingma
- Geoffrey E. Hinton
- Yoshua Bengio
- Ilya Sutskever
- Alec Radford
- Alex Krizhevsky
- Jacob Devlin
- Jimmy Ba
- Alex Graves
- Kaiming He
Who trusts Iz Beltagy overall
- Xiaochuang Han
- Kyle Lo
- Yi Tay
- Arman Cohan
- Suchin Gururangan
- Xiang Dai
- Noah A. Smith
- Jacob Eisenstein
- J. Ainslie
- Ofir Press
Papers from Iz Beltagy's perspective
Ordered by how strongly the researchers Iz Beltagy trusts endorse each paper. Same corpus, a different order for every researcher.
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- Attention is All you Need (Neural Information Processing Systems)
- ImageNet classification with deep convolutional neural networks
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- Long Short-Term Memory
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- ImageNet: A large-scale hierarchical image database
- Gradient-based learning applied to document recognition
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
- Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)
Their papers
- Longformer: The Long-Document Transformer (2020) — 5,720 citations
- Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks (2020) — 3,085 citations
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model (2022) — 2,975 citations
- What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? (2022) — 236 citations
- SciBERT: A Pretrained Language Model for Scientific Text (2019) — 3,836 citations
- FLEX: Unifying Evaluation for Few-Shot NLP (2021) — 113 citations
- What Language Model to Train if You Have One Million GPU Hours? (2022) — 125 citations
- Few-Shot Self-Rationalization with Natural Language Prompts (2021) — 119 citations
- A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers (2021) — 547 citations
- ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing (2019) — 870 citations
- How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources (2023) — 510 citations
- Construction of the Literature Graph in Semantic Scholar (2018) — 442 citations
- SPECTER: Document-level Representation Learning using Citation-informed Transformers (2020) — 853 citations
- SciBERT: Pretrained Contextualized Embeddings for Scientific Text (2019) — 228 citations
- Don’t Say What You Don’t Know: Improving the Consistency of Abstractive Summarization by Constraining Beam Search (2022) — 36 citations
- PRIMER: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization (2021) — 31 citations
- MSˆ2: Multi-Document Summarization of Medical Studies (2021) — 147 citations