RETAIN: An Interpretable Predictive Model for Healthcare using Reverse Time Attention Mechanism

By Edward Choi, Mohammad Taha Bahadori, Jimeng Sun, Joshua A. Kulas, Andy Schuetz, Walter F. Stewart. 2016

1,544 citations recorded by the source corpus.

Accuracy and interpretability are two dominant features of successful predictive models. Typically, a choice must be made in favor of complex black box models such as recurrent neural networks (RNN) for accuracy versus less accurate but more interpretable traditional models such as logistic regression. This tradeoff poses challenges in medicine where both accuracy and interpretability are important. We addressed this challenge by developing the REverse Time AttentIoN model (RETAIN) for application to Electronic Health Records (EHR) data. RETAIN achieves high accuracy while remaining clinically interpretable and is based on a two-level neural attention model that detects influential past visits and significant clinical variables within those visits (e.g. key diagnoses). RETAIN mimics physician practice by attending the EHR data in a reverse time order so that recent clinical visits are likely to receive higher attention. RETAIN was tested on a large health system EHR dataset with 14 million visits completed by 263K patients over an 8 year period and demonstrated predictive accuracy and computational scalability comparable to state-of-the-art methods such as RNN, and ease of interpretability comparable to traditional models.

Subfields: Artificial Intelligence, Safety, Robustness & Interpretability, Medical & Health AI

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Mohit Bansal
  2. Percy Liang
  3. Yoshua Bengio
  4. Graham Neubig
  5. Jianfeng Gao
  6. Quoc V. Le
  7. Luke S. Zettlemoyer
  8. Yoav Goldberg

In Safety, Robustness & Interpretability

  1. Salvatore Ruggieri
  2. Dino Pedreschi
  3. Tomas Pfister
  4. Sercan Ö. Arik
  5. Franco Turini
  6. Bryan Lim
  7. Bettina Berendt
  8. Ilya Shpitser

In Medical & Health AI

  1. Mihaela van der Schaar
  2. Jimeng Sun
  3. Cao Xiao
  4. Edward Choi
  5. Bryan Lim
  6. Fei Wang
  7. Hongyuan Zha
  8. Xiaofeng He

Citations in the corpus