Privacy-Preserving Glycemic Management in Type 1 Diabetes: Development and Validation of a Multiobjective Federated Reinforcement Learning Framework.

Q2 Medicine
JMIR Diabetes Pub Date : 2025-07-04 DOI:10.2196/72874
Fatemeh Sarani Rad, Juan Li
{"title":"Privacy-Preserving Glycemic Management in Type 1 Diabetes: Development and Validation of a Multiobjective Federated Reinforcement Learning Framework.","authors":"Fatemeh Sarani Rad, Juan Li","doi":"10.2196/72874","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Effective diabetes management requires precise glycemic control to prevent both hypoglycemia and hyperglycemia, yet existing machine learning (ML) and reinforcement learning (RL) approaches often fail to balance competing objectives. Traditional RL-based glucose regulation systems primarily focus on single-objective optimization, overlooking factors such as minimizing insulin overuse, reducing glycemic variability, and ensuring patient safety. Furthermore, these approaches typically rely on centralized data processing, which raises privacy concerns due to the sensitive nature of health care data. There is a critical need for a decentralized, privacy-preserving framework that can personalize blood glucose regulation while addressing the multiobjective nature of diabetes management.</p><p><strong>Objective: </strong>This study aimed to develop and validate PRIMO-FRL (Privacy-Preserving Reinforcement Learning for Individualized Multi-Objective Glycemic Management Using Federated Reinforcement Learning), a novel framework that optimizes clinical objectives-maximizing time in range (TIR), reducing hypoglycemia and hyperglycemia, and minimizing glycemic risk-while preserving patient privacy.</p><p><strong>Methods: </strong>We developed PRIMO-FRL, integrating multiobjective reward shaping to dynamically balance glucose stability, insulin efficiency, and risk reduction. The model was trained and tested using simulated data from 30 simulated patients (10 children, 10 adolescents, and 10 adults) generated with the Food and Drug Administration (FDA)-approved UVA/Padova simulator. A comparative analysis was conducted against state-of-the-art RL and ML models, evaluating performance using metrics such as TIR, hypoglycemia (<70 mg/dL), hyperglycemia (>180 mg/dL), and glycemic risk scores.</p><p><strong>Results: </strong>The PRIMO-FRL model achieved a robust overall TIR of 76.54%, with adults demonstrating the highest TIR at 81.48%, followed by children at 77.78% and adolescents at 70.37%. Importantly, the approach eliminated hypoglycemia, with 0.0% spent below 70 mg/dL across all cohorts, significantly outperforming existing methods. Mild hyperglycemia (180-250 mg/dL) was observed in adolescents (29.63%), children (22.22%), and adults (18.52%), with adults exhibiting the best control. Furthermore, the PRIMO-FRL approach consistently reduced glycemic risk scores, demonstrating improved safety and long-term stability in glucose regulation..</p><p><strong>Conclusions: </strong>Our findings highlight the potential of PRIMO-FRL as a transformative, privacy-preserving approach to personalized glycemic management. By integrating federated RL, this framework eliminates hypoglycemia, improves TIR, and preserves data privacy by decentralizing model training. Unlike traditional centralized approaches that require sharing sensitive health data, PRIMO-FRL leverages federated learning to keep patient data local, significantly reducing privacy risks while enabling adaptive and personalized glucose control. This multiobjective optimization strategy offers a scalable, secure, and clinically viable solution for real-world diabetes care. The ability to train personalized models across diverse populations without exposing raw data makes PRIMO-FRL well-suited for deployment in privacy-sensitive health care environments. These results pave the way for future clinical adoption, demonstrating the potential of privacy-preserving artificial intelligence in optimizing glycemic regulation while maintaining security, adaptability, and personalization.</p>","PeriodicalId":52371,"journal":{"name":"JMIR Diabetes","volume":"10 ","pages":"e72874"},"PeriodicalIF":0.0000,"publicationDate":"2025-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12248133/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Diabetes","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/72874","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Effective diabetes management requires precise glycemic control to prevent both hypoglycemia and hyperglycemia, yet existing machine learning (ML) and reinforcement learning (RL) approaches often fail to balance competing objectives. Traditional RL-based glucose regulation systems primarily focus on single-objective optimization, overlooking factors such as minimizing insulin overuse, reducing glycemic variability, and ensuring patient safety. Furthermore, these approaches typically rely on centralized data processing, which raises privacy concerns due to the sensitive nature of health care data. There is a critical need for a decentralized, privacy-preserving framework that can personalize blood glucose regulation while addressing the multiobjective nature of diabetes management.

Objective: This study aimed to develop and validate PRIMO-FRL (Privacy-Preserving Reinforcement Learning for Individualized Multi-Objective Glycemic Management Using Federated Reinforcement Learning), a novel framework that optimizes clinical objectives-maximizing time in range (TIR), reducing hypoglycemia and hyperglycemia, and minimizing glycemic risk-while preserving patient privacy.

Methods: We developed PRIMO-FRL, integrating multiobjective reward shaping to dynamically balance glucose stability, insulin efficiency, and risk reduction. The model was trained and tested using simulated data from 30 simulated patients (10 children, 10 adolescents, and 10 adults) generated with the Food and Drug Administration (FDA)-approved UVA/Padova simulator. A comparative analysis was conducted against state-of-the-art RL and ML models, evaluating performance using metrics such as TIR, hypoglycemia (<70 mg/dL), hyperglycemia (>180 mg/dL), and glycemic risk scores.

Results: The PRIMO-FRL model achieved a robust overall TIR of 76.54%, with adults demonstrating the highest TIR at 81.48%, followed by children at 77.78% and adolescents at 70.37%. Importantly, the approach eliminated hypoglycemia, with 0.0% spent below 70 mg/dL across all cohorts, significantly outperforming existing methods. Mild hyperglycemia (180-250 mg/dL) was observed in adolescents (29.63%), children (22.22%), and adults (18.52%), with adults exhibiting the best control. Furthermore, the PRIMO-FRL approach consistently reduced glycemic risk scores, demonstrating improved safety and long-term stability in glucose regulation..

Conclusions: Our findings highlight the potential of PRIMO-FRL as a transformative, privacy-preserving approach to personalized glycemic management. By integrating federated RL, this framework eliminates hypoglycemia, improves TIR, and preserves data privacy by decentralizing model training. Unlike traditional centralized approaches that require sharing sensitive health data, PRIMO-FRL leverages federated learning to keep patient data local, significantly reducing privacy risks while enabling adaptive and personalized glucose control. This multiobjective optimization strategy offers a scalable, secure, and clinically viable solution for real-world diabetes care. The ability to train personalized models across diverse populations without exposing raw data makes PRIMO-FRL well-suited for deployment in privacy-sensitive health care environments. These results pave the way for future clinical adoption, demonstrating the potential of privacy-preserving artificial intelligence in optimizing glycemic regulation while maintaining security, adaptability, and personalization.

保护隐私的1型糖尿病血糖管理:多目标联合强化学习框架的开发和验证。
背景:有效的糖尿病管理需要精确的血糖控制来预防低血糖和高血糖,然而现有的机器学习(ML)和强化学习(RL)方法往往无法平衡相互竞争的目标。传统的基于rl的血糖调节系统主要侧重于单目标优化,忽略了诸如减少胰岛素过度使用、降低血糖变异性和确保患者安全等因素。此外,这些方法通常依赖于集中的数据处理,由于医疗保健数据的敏感性,这引起了隐私问题。目前迫切需要一种分散的、隐私保护的框架,既能个性化血糖调节,又能解决糖尿病管理的多目标性质。目的:本研究旨在开发和验证PRIMO-FRL(隐私保护强化学习用于使用联邦强化学习的个性化多目标血糖管理),这是一个优化临床目标的新框架-最大化时间范围(TIR),减少低血糖和高血糖,并最大限度地降低血糖风险,同时保护患者隐私。方法:我们开发了PRIMO-FRL,整合多目标奖励塑造来动态平衡葡萄糖稳定性,胰岛素效率和风险降低。该模型使用美国食品和药物管理局(FDA)批准的UVA/Padova模拟器生成的30名模拟患者(10名儿童,10名青少年和10名成人)的模拟数据进行训练和测试。对最先进的RL和ML模型进行了比较分析,使用TIR、低血糖(180 mg/dL)和血糖风险评分等指标评估性能。结果:PRIMO-FRL模型获得了76.54%的稳健总体TIR,其中成人TIR最高,为81.48%,其次是儿童77.78%,青少年70.37%。重要的是,该方法消除了低血糖,在所有队列中有0.0%的人低于70 mg/dL,显著优于现有方法。青少年(29.63%)、儿童(22.22%)和成人(18.52%)出现轻度高血糖(180-250 mg/dL),其中成人控制效果最好。此外,PRIMO-FRL方法持续降低血糖风险评分,证明了血糖调节的安全性和长期稳定性。结论:我们的研究结果强调了PRIMO-FRL作为一种变革性、隐私保护的个性化血糖管理方法的潜力。通过集成联邦强化学习,该框架消除了低血糖,提高了TIR,并通过分散模型训练来保护数据隐私。与需要共享敏感健康数据的传统集中式方法不同,PRIMO-FRL利用联邦学习将患者数据保持在本地,在实现自适应和个性化血糖控制的同时显著降低隐私风险。这种多目标优化策略为现实世界的糖尿病护理提供了一种可扩展、安全且临床可行的解决方案。在不暴露原始数据的情况下在不同人群中训练个性化模型的能力使PRIMO-FRL非常适合在隐私敏感的医疗保健环境中部署。这些结果为未来的临床应用铺平了道路,展示了保护隐私的人工智能在优化血糖调节的同时保持安全性、适应性和个性化的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
JMIR Diabetes
JMIR Diabetes Computer Science-Computer Science Applications
CiteScore
4.00
自引率
0.00%
发文量
35
审稿时长
16 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信