Foundation models for generalist medical artificial intelligence

By Michael Moor, Oishi Banerjee, Zahra F H Abad, H. Krumholz, Jure Leskovec, Eric J. Topol, Pranav Rajpurkar. Nature, 2023

1,871 citations recorded by the source corpus.

The exceptionally rapid development of highly flexible, reusable artificial intelligence (AI) models is likely to usher in newfound capabilities in medicine. We propose a new paradigm for medical AI, which we refer to as generalist medical AI (GMAI). GMAI models will be capable of carrying out a diverse set of tasks using very little or no task-specific labelled data. Built through self-supervision on large, diverse datasets, GMAI will flexibly interpret different combinations of medical modalities, including data from imaging, electronic health records, laboratory results, genomics, graphs or medical text. Models will in turn produce expressive outputs such as free-text explanations, spoken recommendations or image annotations that demonstrate advanced medical reasoning abilities. Here we identify a set of high-impact potential applications for GMAI and lay out specific technical capabilities and training datasets necessary to enable them. We expect that GMAI-enabled applications will challenge current strategies for regulating and validating AI devices for medicine and will shift practices associated with the collection of large medical datasets. This review discusses generalist medical artificial intelligence, identifying potential applications and setting out specific technical capabilities and training datasets necessary to enable them, as well as highlighting challenges to its implementation.

Subfields: Artificial Intelligence, Health Informatics, Radiology, Nuclear Medicine and Imaging

View Paper: https://www.semanticscholar.org/paper/9faa2b0e5cb93f20df0555c3c350fab0b2eccf3a

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Percy Liang
  2. Mohit Bansal
  3. Quoc V. Le
  4. Yoshua Bengio
  5. Jianfeng Gao
  6. Luke S. Zettlemoyer
  7. Ruslan Salakhutdinov
  8. Caiming Xiong

In Health Informatics

  1. Pranav Rajpurkar
  2. Hoifung Poon

In Radiology, Nuclear Medicine and Imaging

  1. Pranav Rajpurkar
  2. Matthew P. Lungren
  3. Alan L. Yuille
  4. Jure Leskovec
  5. Dimitris N. Metaxas
  6. Shaoting Zhang
  7. Bradley Green
  8. Simon Kornblith

Citations in the corpus