Learning to Diagnose with LSTM Recurrent Neural Networks

By Zachary Chase Lipton, David C. Kale, Charles Peter Elkan, Randall C. Wetzel. 2015

1,224 citations recorded by the source corpus.

Clinical medical data, especially in the intensive care unit (ICU), consist of multivariate time series of observations. For each patient visit (or episode), sensor data and lab test results are recorded in the patient's Electronic Health Record (EHR). While potentially containing a wealth of insights, the data is difficult to mine effectively, owing to varying length, irregular sampling and missing data. Recurrent Neural Networks (RNNs), particularly those using Long Short-Term Memory (LSTM) hidden units, are powerful and increasingly popular models for learning from sequence data. They effectively model varying length sequences and capture long range dependencies. We present the first study to empirically evaluate the ability of LSTMs to recognize patterns in multivariate time series of clinical measurements. Specifically, we consider multilabel classification of diagnoses, training a model to classify 128 diagnoses given 13 frequently but irregularly sampled clinical measurements. First, we establish the effectiveness of a simple LSTM network for modeling clinical data. Then we demonstrate a straightforward and effective training strategy in which we replicate targets at each sequence step. Trained only on raw time series, our models outperform several strong baselines, including a multilayer perceptron trained on hand-engineered features.

Subfields: Artificial Intelligence, Model Architectures, Medical & Health AI, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Jianfeng Gao
  3. Yoshua Bengio
  4. Percy Liang
  5. Quoc V. Le
  6. Luke S. Zettlemoyer
  7. Ruslan Salakhutdinov
  8. Yejin Choi

In Model Architectures

  1. Mihaela van der Schaar
  2. Wei Zhang
  3. Jimeng Sun
  4. Edward Choi
  5. Bryan Lim
  6. Quoc V. Le
  7. Hanxiao Liu
  8. Zachary Chase Lipton

In Medical & Health AI

  1. Mihaela van der Schaar
  2. Jimeng Sun
  3. Cao Xiao
  4. Bryan Lim
  5. Edward Choi
  6. Fei Wang
  7. Joseph D. Futoma
  8. Hongyuan Zha

In Signal Processing

  1. Zachary Chase Lipton
  2. David C. Kale
  3. Randall C. Wetzel
  4. Bryan Lim
  5. Yuan Luo
  6. Edward Choi
  7. Mihaela van der Schaar
  8. Jimeng Sun

Citations in the corpus