Controlling blood glucose variability under uncertainty using reinforcement learning and Gaussian processes

By Mariano De Paula, L. Ávila, Ernesto C. Martínez. 2015

33 citations recorded by the source corpus.

Simulation-based learning of an optimal control policy for an artificial pancreas.Integration of reinforcement learning with Gaussian processes for policy iteration.Responding promptly to the varying activity levels seen in outpatients.Stochastic modeling of diabetic patients for controlling variability. Automated control of blood glucose (BG) concentration with a fully automated artificial pancreas will certainly improve the quality of life for insulin-dependent patients. Closed-loop insulin delivery is challenging due to inter- and intra-patient variability, errors in glucose sensors and delays in insulin absorption. Responding to the varying activity levels seen in outpatients, with unpredictable and unreported food intake, and providing the necessary personalized control for individuals is a challenging task for existing control algorithms. A novel approach for controlling glycemic variability using simulation-based learning is presented. A policy iteration algorithm that combines reinforcement learning with Gaussian process approximation is proposed. To account for multiple sources of uncertainty, a control policy is learned off-line using an Ito's stochastic model of the glucose-insulin dynamics. For safety and performance, only relevant data are sampled through Bayesian active learning. Results obtained demonstrate that a generic policy is both safe and efficient for controlling subject-specific variability due to a patient's lifestyle and its distinctive metabolic response.

Subfields: Endocrinology, Diabetes and Metabolism, Genetics

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Endocrinology, Diabetes and Metabolism

1. Shamim Nemati
2. Chao Yu
3. Jiming Liu

In Genetics

1. Shamim Nemati
2. Chao Yu
3. Jiming Liu

Citations in the corpus

• Reinforcement Learning in Healthcare: A Survey (2019, background): “[127], [128] proposed policy learning algorithms that integrates RL with”