Giada Lops, Vito Andrea Racanelli, Gioacchino Manfredi, Luca De Cicco, Saverio Mascolo
{"title":"A Deep Deterministic Policy Gradient control algorithm for Automatic Insulin Delivery","authors":"Giada Lops, Vito Andrea Racanelli, Gioacchino Manfredi, Luca De Cicco, Saverio Mascolo","doi":"10.1016/j.ifacol.2025.06.003","DOIUrl":null,"url":null,"abstract":"<div><div>This study investigates the use of Reinforcement Learning (RL) to optimize insulin infusion in Automated Insulin Delivery (AID) systems. The Deep Deterministic Policy Gradient (DDPG) algorithm is evaluated as a potential control strategy and compared to Model Predictive Control (MPC) and PID controllers using a highly realistic in silico simulation model. Simulations for adult Type 1 Diabetes (T1D) patients demonstrate that the DDPG controller effectively reduces hypo- and hyperglycemic episodes and improves glucose stability.</div></div>","PeriodicalId":37894,"journal":{"name":"IFAC-PapersOnLine","volume":"59 2","pages":"Pages 13-18"},"PeriodicalIF":0.0000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IFAC-PapersOnLine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2405896325003076","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Engineering","Score":null,"Total":0}
引用次数: 0
Abstract
This study investigates the use of Reinforcement Learning (RL) to optimize insulin infusion in Automated Insulin Delivery (AID) systems. The Deep Deterministic Policy Gradient (DDPG) algorithm is evaluated as a potential control strategy and compared to Model Predictive Control (MPC) and PID controllers using a highly realistic in silico simulation model. Simulations for adult Type 1 Diabetes (T1D) patients demonstrate that the DDPG controller effectively reduces hypo- and hyperglycemic episodes and improves glucose stability.
期刊介绍:
All papers from IFAC meetings are published, in partnership with Elsevier, the IFAC Publisher, in theIFAC-PapersOnLine proceedings series hosted at the ScienceDirect web service. This series includes papers previously published in the IFAC website.The main features of the IFAC-PapersOnLine series are: -Online archive including papers from IFAC Symposia, Congresses, Conferences, and most Workshops. -All papers accepted at the meeting are published in PDF format - searchable and citable. -All papers published on the web site can be cited using the IFAC PapersOnLine ISSN and the individual paper DOI (Digital Object Identifier). The site is Open Access in nature - no charge is made to individuals for reading or downloading. Copyright of all papers belongs to IFAC and must be referenced if derivative journal papers are produced from the conference papers. All papers published in IFAC-PapersOnLine have undergone a peer review selection process according to the IFAC rules.