Recurrent Neural Networks for Multivariate Time Series with Missing Values

By Zhengping Che, Sanjay Purushotham, Kyunghyun Cho, David A. Sontag, Yan Liu. 2016

2,465 citations recorded by the source corpus.

Multivariate time series data in practical applications, such as health care, geoscience, and biology, are characterized by a variety of missing values. In time series prediction and other related tasks, it has been noted that missing values and their missing patterns are often correlated with the target labels, a.k.a., informative missingness. There is very limited work on exploiting the missing patterns for effective imputation and improving prediction performance. In this paper, we develop novel deep learning models, namely GRU-D, as one of the early attempts. GRU-D is based on Gated Recurrent Unit (GRU), a state-of-the-art recurrent neural network. It takes two representations of missing patterns, i.e., masking and time interval, and effectively incorporates them into a deep model architecture so that it not only captures the long-term temporal dependencies in time series, but also utilizes the missing patterns to achieve better prediction results. Experiments of time series classification tasks on real-world clinical datasets (MIMIC-III, PhysioNet) and synthetic datasets demonstrate that our models achieve state-of-the-art performance and provide useful insights for better understanding and utilization of missing values in time series analysis.

Subfields: Artificial Intelligence, Health Information Management, Model Architectures, Medical & Health AI, Signal Processing

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

  1. Yoshua Bengio
  2. Mohit Bansal
  3. Quoc V. Le
  4. Jianfeng Gao
  5. Sergey Levine
  6. Percy Liang
  7. Ruslan Salakhutdinov
  8. Stefano Ermon

In Health Information Management

  1. Jimeng Sun
  2. Yuan Luo
  3. Cao Xiao
  4. Fei Wang
  5. Joseph D. Futoma
  6. Mihaela van der Schaar
  7. Edward Choi
  8. Phebe Vayanos

In Model Architectures

  1. Quoc V. Le
  2. Christopher R'e
  3. Tri Dao
  4. Stefano Ermon
  5. Atri Rudra
  6. Albert Gu
  7. Ricky T. Q. Chen
  8. Hanxiao Liu

In Medical & Health AI

  1. Mihaela van der Schaar
  2. Jimeng Sun
  3. Fei Wang
  4. Cao Xiao
  5. Edward Choi
  6. Joseph D. Futoma
  7. Yuan Luo
  8. Phebe Vayanos

In Signal Processing

  1. Zachary Chase Lipton
  2. Yuan Luo
  3. Christopher R'e
  4. Joseph D. Futoma
  5. Albert Gu
  6. Karan Goel
  7. Ricky T. Q. Chen
  8. Yang Song

Citations in the corpus