Kyle Lo
Artificial Intelligence · 2018–2024
A researcher in the Science corpus: 19 papers; trusts 692 researchers and is trusted by 178 researchers here, as inferred from the citation graph.
Subfields
- Artificial Intelligence — 624 citations into it; #2,563 of 36,961 by trust here, #1,282 by citations
- Natural Language Processing — 385 citations into it; #910 of 5,725 by trust here, #951 by citations
- Evaluation & Benchmarks — 178 citations into it; #1,369 of 3,155 by trust here, #925 by citations
- Large Language Models — 151 citations into it; #80 of 810 by trust here, #160 by citations
- Computer Vision and Pattern Recognition — 146 citations into it
- Molecular Biology — 66 citations into it; #773 of 17,836 by trust here, #2,041 by citations
- Information Systems — 64 citations into it; #5,712 of 9,233 by trust here, #4,516 by citations
- Representation & Self-Supervised Learning — 42 citations into it
Whom Kyle Lo trusts overall
Their strongest outbound trust, strongest first, inferred from their citations.
- Diederik P. Kingma
- Jacob Devlin
- Geoffrey E. Hinton
- Ilya Sutskever
- Yoshua Bengio
- Tomas Mikolov
- Jimmy Ba
- Alex Krizhevsky
- Mark Neumann
- Yann LeCun
Who trusts Kyle Lo overall
- Suchin Gururangan
- Iz Beltagy
- Hong-Liu Cao
- Arman Cohan
- Zixuan Ke
- Xiaochuang Han
- Jay DeYoung
- Katikapalli Subramanyam Kalyan
- Ana Marasovic
- Lucy Lu Wang
Papers from Kyle Lo's perspective
Ordered by how strongly the researchers Kyle Lo trusts endorse each paper. Same corpus, a different order for every researcher.
- Long Short-Term Memory
- Attention is All you Need (Neural Information Processing Systems)
- Deep Residual Learning for Image Recognition (Computer Vision and Pattern Recognition)
- Adam: A Method for Stochastic Optimization (International Conference on Learning Representations)
- ImageNet classification with deep convolutional neural networks
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (North American Chapter of the Association for Computational Linguistics)
- ImageNet: A large-scale hierarchical image database
- Sequence to Sequence Learning with Neural Networks (Neural Information Processing Systems)
- Gradient-based learning applied to document recognition
- Neural Machine Translation by Jointly Learning to Align and Translate (International Conference on Learning Representations)
Their papers
- Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks (2020) — 3,085 citations
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model (2022) — 2,975 citations
- SciBERT: A Pretrained Language Model for Scientific Text (2019) — 3,836 citations
- S2ORC: The Semantic Scholar Open Research Corpus (2020) — 814 citations
- Data Governance in the Age of Large-Scale Data-Driven Language Technology (2022) — 65 citations
- FLEX: Unifying Evaluation for Few-Shot NLP (2021) — 113 citations
- Fact or Fiction: Verifying Scientific Claims (2020) — 755 citations
- A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers (2021) — 547 citations
- Construction of the Literature Graph in Semantic Scholar (2018) — 442 citations
- SciBERT: Pretrained Contextualized Embeddings for Scientific Text (2019) — 228 citations
- The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset (2023) — 217 citations
- Cooperative Generator-Discriminator Networks for Abstractive Summarization with Narrative Flow (2019) — 11 citations
- OLMo: Accelerating the Science of Language Models (2024) — 700 citations
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research (2024) — 519 citations
- CORD-19: The Covid-19 Open Research Dataset (2020) — 876 citations
- TLDR: Extreme Summarization of Scientific Documents (2020) — 291 citations
- TREC-COVID: rationale and structure of an information retrieval shared task for COVID-19 (2020) — 130 citations
- TREC-COVID (2020) — 94 citations
- GORC: A large contextual citation graph of academic papers (2019) — 11 citations