Structured information extraction from scientific text with large language models
By John Dagdelen, Alex Dunn, Sanghoon Lee, Nicholas Walker, Andrew S. Rosen, Gerbrand Ceder, Kristin A. Persson, Anubhav Jain. Nature Communications, 2024
652 citations recorded by the source corpus.
Extracting structured knowledge from scientific text remains a challenging task for machine learning models. Here, we present a simple approach to joint named entity recognition and relation extraction and demonstrate how pretrained large language models (GPT-3, Llama-2) can be fine-tuned to extract useful records of complex scientific knowledge. We test three representative tasks in materials chemistry: linking dopants and host materials, cataloging metal-organic frameworks, and general composition/phase/morphology/application information extraction. Records are extracted from single sentences or entire paragraphs, and the output can be returned as simple English sentences or a more structured format such as a list of JSON objects. This approach represents a simple, accessible, and highly flexible route to obtaining large databases of structured specialized scientific knowledge extracted from research papers.
Subfields: Artificial Intelligence, Materials Chemistry, Molecular Biology
View Paper: https://www.semanticscholar.org/paper/da54bda4ef0ba0f013ac639fb6a3dea1e4745ad4
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
- Wenjun Peng
- Yefeng Zheng
- Wei Chen
- Chao Zhang
- Xiangyu Zhao
- Derong Xu
- Enhong Chen
- Tong Xu
Citations in the corpus
- Large language models for generative information extraction: a survey (2023, background): “…information from some specific domains, such as mulitmodal [57, 94, 166, 167], multilingual [83, 133, 163], medical [85, 91, 162, 163, 171, 172, 179, 183, 184, 185, 186, 187, 188, 234, 235], scientific [47, 80, 180, 181, 182], astronomical [164, 173], historical [126, 189], and legal [78, 89, 115].”