基于高效深度 Q 学习方法的艾滋病患者最佳性传播感染控制方法。

IF 1.9 4区 数学 Q2 BIOLOGY
Changyeon Yoon , Jaemoo Choi , Hee-Dae Kwon , Myungjoo Kang
{"title":"基于高效深度 Q 学习方法的艾滋病患者最佳性传播感染控制方法。","authors":"Changyeon Yoon ,&nbsp;Jaemoo Choi ,&nbsp;Hee-Dae Kwon ,&nbsp;Myungjoo Kang","doi":"10.1016/j.jtbi.2024.111914","DOIUrl":null,"url":null,"abstract":"<div><p>We investigate an efficient computational tool to suggest useful treatment regimens for people infected with the human immunodeficiency virus (HIV). Structured treatment interruption (STI) is a regimen in which therapeutic drugs are periodically administered and withdrawn to give patients relief from an arduous drug therapy. Numerous studies have been conducted to find better STI treatment strategies using various computational tools with mathematical models of HIV infection. In this paper, we leverage a modified version of the double deep Q network with prioritized experience replay to improve the performance of classic deep learning algorithms. Numerical simulation results show that our methodology produces significantly more optimal cost values for shorter treatment periods compared to other recent studies. Furthermore, our proposed algorithm performs well in one-day segment scenarios, whereas previous studies only reported results for five-day segment scenarios.</p></div>","PeriodicalId":54763,"journal":{"name":"Journal of Theoretical Biology","volume":"594 ","pages":"Article 111914"},"PeriodicalIF":1.9000,"publicationDate":"2024-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Optimal STI controls for HIV patients based on an efficient deep Q learning method\",\"authors\":\"Changyeon Yoon ,&nbsp;Jaemoo Choi ,&nbsp;Hee-Dae Kwon ,&nbsp;Myungjoo Kang\",\"doi\":\"10.1016/j.jtbi.2024.111914\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>We investigate an efficient computational tool to suggest useful treatment regimens for people infected with the human immunodeficiency virus (HIV). Structured treatment interruption (STI) is a regimen in which therapeutic drugs are periodically administered and withdrawn to give patients relief from an arduous drug therapy. Numerous studies have been conducted to find better STI treatment strategies using various computational tools with mathematical models of HIV infection. In this paper, we leverage a modified version of the double deep Q network with prioritized experience replay to improve the performance of classic deep learning algorithms. Numerical simulation results show that our methodology produces significantly more optimal cost values for shorter treatment periods compared to other recent studies. Furthermore, our proposed algorithm performs well in one-day segment scenarios, whereas previous studies only reported results for five-day segment scenarios.</p></div>\",\"PeriodicalId\":54763,\"journal\":{\"name\":\"Journal of Theoretical Biology\",\"volume\":\"594 \",\"pages\":\"Article 111914\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2024-08-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Theoretical Biology\",\"FirstCategoryId\":\"99\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0022519324001991\",\"RegionNum\":4,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"BIOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Theoretical Biology","FirstCategoryId":"99","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0022519324001991","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"BIOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

我们研究了一种高效的计算工具,用于为人类免疫缺陷病毒(HIV)感染者提出有用的治疗方案。结构化治疗中断(STI)是一种定期给药和停药的治疗方案,目的是让患者从艰苦的药物治疗中解脱出来。为了找到更好的 STI 治疗策略,人们利用各种计算工具和 HIV 感染数学模型进行了大量研究。在本文中,我们利用具有优先经验重放功能的双深度 Q 网络的改进版来提高经典深度学习算法的性能。数值模拟结果表明,与近期的其他研究相比,我们的方法能在更短的治疗周期内产生明显更多的最优成本值。此外,我们提出的算法在一天的分段场景中表现良好,而之前的研究只报告了五天分段场景的结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Optimal STI controls for HIV patients based on an efficient deep Q learning method

We investigate an efficient computational tool to suggest useful treatment regimens for people infected with the human immunodeficiency virus (HIV). Structured treatment interruption (STI) is a regimen in which therapeutic drugs are periodically administered and withdrawn to give patients relief from an arduous drug therapy. Numerous studies have been conducted to find better STI treatment strategies using various computational tools with mathematical models of HIV infection. In this paper, we leverage a modified version of the double deep Q network with prioritized experience replay to improve the performance of classic deep learning algorithms. Numerical simulation results show that our methodology produces significantly more optimal cost values for shorter treatment periods compared to other recent studies. Furthermore, our proposed algorithm performs well in one-day segment scenarios, whereas previous studies only reported results for five-day segment scenarios.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
4.20
自引率
5.00%
发文量
218
审稿时长
51 days
期刊介绍: The Journal of Theoretical Biology is the leading forum for theoretical perspectives that give insight into biological processes. It covers a very wide range of topics and is of interest to biologists in many areas of research, including: • Brain and Neuroscience • Cancer Growth and Treatment • Cell Biology • Developmental Biology • Ecology • Evolution • Immunology, • Infectious and non-infectious Diseases, • Mathematical, Computational, Biophysical and Statistical Modeling • Microbiology, Molecular Biology, and Biochemistry • Networks and Complex Systems • Physiology • Pharmacodynamics • Animal Behavior and Game Theory Acceptable papers are those that bear significant importance on the biology per se being presented, and not on the mathematical analysis. Papers that include some data or experimental material bearing on theory will be considered, including those that contain comparative study, statistical data analysis, mathematical proof, computer simulations, experiments, field observations, or even philosophical arguments, which are all methods to support or reject theoretical ideas. However, there should be a concerted effort to make papers intelligible to biologists in the chosen field.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信