TY - GEN
T1 - Artificial Pancreas Control for Diabetes using TD3 Deep Reinforcement Learning
AU - Mackey, Alan
AU - Furey, Eoghan
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Diabetes Mellitus is a chronic condition that affects approximately 6.5% of the population in Ireland. As well as being a burden on those who suffer from it, it is a huge burden to the state and accounts for approximately 10% of total global health spend. Diabetes cannot be managed from a clinical setting so there is a requirement for self-management with a constant need to understand what current blood glucose values are and responding by treatment with an appropriate dose of insulin. Fortunately, diabetes technology has improved dramatically in the last number of years with the invention of the continuous glucose monitor (CGM) that can report a blood glucose reading as frequently as every five minutes and insulin pumps that infuse insulin in frequent small doses mimicking endogenous insulin. Currently humans are still required to manage these devices, but it is every patient's (and clinicians) wish to close the loop and automate control. This study looks at control algorithms and asks if deep reinforcement learning (DRL) can be used as a potential solution for devising patient specific policies for control. A Twin Delayed Deep Deterministic Policy Gradient (TD3) model is implemented in a simulated environment and tested on three in-silico patients. The results show promise in controlling blood glucose profiles for the patients but in a limited setting. It concludes that while DRL is capable of learning to control blood glucose further research is required before it could be considered for human use.
AB - Diabetes Mellitus is a chronic condition that affects approximately 6.5% of the population in Ireland. As well as being a burden on those who suffer from it, it is a huge burden to the state and accounts for approximately 10% of total global health spend. Diabetes cannot be managed from a clinical setting so there is a requirement for self-management with a constant need to understand what current blood glucose values are and responding by treatment with an appropriate dose of insulin. Fortunately, diabetes technology has improved dramatically in the last number of years with the invention of the continuous glucose monitor (CGM) that can report a blood glucose reading as frequently as every five minutes and insulin pumps that infuse insulin in frequent small doses mimicking endogenous insulin. Currently humans are still required to manage these devices, but it is every patient's (and clinicians) wish to close the loop and automate control. This study looks at control algorithms and asks if deep reinforcement learning (DRL) can be used as a potential solution for devising patient specific policies for control. A Twin Delayed Deep Deterministic Policy Gradient (TD3) model is implemented in a simulated environment and tested on three in-silico patients. The results show promise in controlling blood glucose profiles for the patients but in a limited setting. It concludes that while DRL is capable of learning to control blood glucose further research is required before it could be considered for human use.
KW - Artificial Pancreas
KW - Deep Reinforcement learning
KW - Diabetes
KW - TD3
UR - http://www.scopus.com/inward/record.url?scp=85135932083&partnerID=8YFLogxK
U2 - 10.1109/ISSC55427.2022.9826219
DO - 10.1109/ISSC55427.2022.9826219
M3 - Conference contribution
AN - SCOPUS:85135932083
T3 - 2022 33rd Irish Signals and Systems Conference, ISSC 2022
BT - 2022 33rd Irish Signals and Systems Conference, ISSC 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 33rd Irish Signals and Systems Conference, ISSC 2022
Y2 - 9 June 2022 through 10 June 2022
ER -