Supervised-actor-critic reinforcement learning for intelligent mechanical ventilation and sedative dosing in intensive care units

By Chao Yu, Guoqi Ren, Yinzhao Dong. 2020

40 citations recorded by the source corpus.

Background Reinforcement learning (RL) provides a promising technique to solve complex sequential decision making problems in healthcare domains. Recent years have seen a great progress of applying RL in addressing decision-making problems in Intensive Care Units (ICUs). However, since the goal of traditional RL algorithms is to maximize a long-term reward function, exploration in the learning process may have a fatal impact on the patient. As such, a short-term goal should also be considered to keep the patient stable during the treating process. Methods We use a Supervised-Actor-Critic (SAC) RL algorithm to address this problem by combining the long-term goal-oriented characteristics of RL with the short-term goal of supervised learning. We evaluate the differences between SAC and traditional Actor-Critic (AC) algorithms in addressing the decision making problems of ventilation and sedative dosing in ICUs. Results Results show that SAC is much more efficient than the traditional AC algorithm in terms of convergence rate and data utilization. Conclusions The SAC algorithm not only aims to cure patients in the long term, but also reduces the degree of deviation from the strategy applied by clinical doctors and thus improves the therapeutic effect.

Subfields: Artificial Intelligence, Critical Care and Intensive Care Medicine, Pulmonary and Respiratory Medicine

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Artificial Intelligence

1. Chao Yu
2. Jiming Liu
3. Shamim Nemati
4. Guoqi Ren

In Critical Care and Intensive Care Medicine

1. Shamim Nemati
2. Jiming Liu
3. Chao Yu

In Pulmonary and Respiratory Medicine

1. Shamim Nemati
2. Jiming Liu
3. Chao Yu

Citations in the corpus

• Reinforcement Learning in Healthcare: A Survey (2019, methodology): “applied Bayesian inverse RL [219] and Supervised-actorcritic [220] to learn a suitable ventilator weaning policy from real trajectories in retrospective ICU data.”