Can past variants of SARS-CoV-2 predict the impact of future variants? Machine learning for early warning of US counties at risk.

IF 2.8 3区 医学 Q2 HEALTH POLICY & SERVICES
Health Care Management Science Pub Date : 2025-12-01 Epub Date: 2025-10-13 DOI:10.1007/s10729-025-09728-4
Kevin B Smith, Siqian Shen, Brian T Denton
{"title":"Can past variants of SARS-CoV-2 predict the impact of future variants? Machine learning for early warning of US counties at risk.","authors":"Kevin B Smith, Siqian Shen, Brian T Denton","doi":"10.1007/s10729-025-09728-4","DOIUrl":null,"url":null,"abstract":"<p><p>In this paper, we determine whether machine learning (ML) models created using data from the novel SARS-CoV-2 Alpha variant can prospectively predict county-level incidence of emerging variants, validated using data of the Omicron variant. We first select publicly-available sociodemographic, economic, and health-related characteristics of 3140 United States (US) counties at the time of the confirmed early US outbreak of the novel SARS-CoV-2 virus in March 2020 for analysis. Our primary result is the set of US counties that experienced the upper quartile of population-adjusted Omicron variant incidence at certain period (e.g., 100 days) after Omicron variant's appearance in the US. We show more predictive results by incorporating additional data and features (e.g., human mobility) that can be acquired dynamically after the outbreak, to improve prediction accuracy at the cost of additional waiting time and effort. Towards the goal of decision support, we aim to prospectively evaluate our models' ability to classify and rank US counties at risk. We measure their classification performance using the area under receiver operating characteristic curve score with 95% confidence intervals. We further calculate the proportion of the top counties by Omicron incidence that our models correctly identify, and compare their score with those of individual county-level features that can serve as a heuristic predictive performance baseline. Our results show that ML algorithms predict county-level Omicron variant incidence with better performance than natural heuristics that decision makers might otherwise use. More generally, historical data from the first wave of a novel pandemic can help predict the incidence of future variants and strengthen state or federal pandemic response interventions. HIGHLIGHTS: Data-driven predictive models that capture patterns from early viral variants can support policymaking related to emerging viral variants. County-level sociodemographic, health, and economic characteristics are predictive of early COVID-19 outcomes in the United States (US). Machine learning models trained on early US county-level COVID-19 outcomes are additionally predictive of county-level SARS-CoV-2 Omicron variant outcomes. County-level machine learning models can be used as a critical policymaking tool given the inevitability of novel emerging viruses.</p>","PeriodicalId":12903,"journal":{"name":"Health Care Management Science","volume":" ","pages":"738-758"},"PeriodicalIF":2.8000,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12743673/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health Care Management Science","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s10729-025-09728-4","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/10/13 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"HEALTH POLICY & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

In this paper, we determine whether machine learning (ML) models created using data from the novel SARS-CoV-2 Alpha variant can prospectively predict county-level incidence of emerging variants, validated using data of the Omicron variant. We first select publicly-available sociodemographic, economic, and health-related characteristics of 3140 United States (US) counties at the time of the confirmed early US outbreak of the novel SARS-CoV-2 virus in March 2020 for analysis. Our primary result is the set of US counties that experienced the upper quartile of population-adjusted Omicron variant incidence at certain period (e.g., 100 days) after Omicron variant's appearance in the US. We show more predictive results by incorporating additional data and features (e.g., human mobility) that can be acquired dynamically after the outbreak, to improve prediction accuracy at the cost of additional waiting time and effort. Towards the goal of decision support, we aim to prospectively evaluate our models' ability to classify and rank US counties at risk. We measure their classification performance using the area under receiver operating characteristic curve score with 95% confidence intervals. We further calculate the proportion of the top counties by Omicron incidence that our models correctly identify, and compare their score with those of individual county-level features that can serve as a heuristic predictive performance baseline. Our results show that ML algorithms predict county-level Omicron variant incidence with better performance than natural heuristics that decision makers might otherwise use. More generally, historical data from the first wave of a novel pandemic can help predict the incidence of future variants and strengthen state or federal pandemic response interventions. HIGHLIGHTS: Data-driven predictive models that capture patterns from early viral variants can support policymaking related to emerging viral variants. County-level sociodemographic, health, and economic characteristics are predictive of early COVID-19 outcomes in the United States (US). Machine learning models trained on early US county-level COVID-19 outcomes are additionally predictive of county-level SARS-CoV-2 Omicron variant outcomes. County-level machine learning models can be used as a critical policymaking tool given the inevitability of novel emerging viruses.

Abstract Image

Abstract Image

Abstract Image

过去的SARS-CoV-2变体能否预测未来变体的影响?机器学习对处于危险中的美国县进行早期预警。
在本文中,我们确定使用新型SARS-CoV-2 Alpha变体数据创建的机器学习(ML)模型是否可以前瞻性地预测新变体的县级发病率,并使用Omicron变体数据进行验证。我们首先选择了美国3140个县在2020年3月确诊的新型SARS-CoV-2病毒早期爆发时可公开获得的社会人口统计学、经济和健康相关特征进行分析。我们的主要结果是在美国出现奥米克隆变异后的某一时期(例如100天),经历了人口调整后的奥米克隆变异发病率的上四分位数的美国县。我们通过合并在疫情爆发后可以动态获得的额外数据和特征(例如,人员流动性)来显示更多的预测结果,以额外的等待时间和精力为代价提高预测准确性。为了实现决策支持的目标,我们的目标是前瞻性地评估我们的模型对处于风险中的美国县进行分类和排名的能力。我们用95%置信区间的接收者工作特征曲线得分下的面积来衡量他们的分类表现。我们进一步计算了我们的模型正确识别的Omicron发生率最高的县的比例,并将其得分与单个县级特征的得分进行比较,这些特征可以作为启发式预测性能基线。我们的研究结果表明,ML算法预测县级Omicron变异发生率比决策者可能使用的自然启发式算法具有更好的性能。更一般地说,来自新型大流行第一波的历史数据可以帮助预测未来变体的发病率,并加强州或联邦大流行应对干预措施。重点:数据驱动的预测模型捕获早期病毒变异的模式,可以支持与新出现的病毒变异相关的政策制定。在美国,县级社会人口、健康和经济特征可预测COVID-19的早期结局。根据美国早期县级COVID-19结果训练的机器学习模型还可以预测县级SARS-CoV-2 Omicron变体结果。鉴于新型病毒的不可避免性,县级机器学习模型可以用作关键的决策工具。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Health Care Management Science
Health Care Management Science HEALTH POLICY & SERVICES-
CiteScore
7.20
自引率
5.60%
发文量
40
期刊介绍: Health Care Management Science publishes papers dealing with health care delivery, health care management, and health care policy. Papers should have a decision focus and make use of quantitative methods including management science, operations research, analytics, machine learning, and other emerging areas. Articles must clearly articulate the relevance and the realized or potential impact of the work. Applied research will be considered and is of particular interest if there is evidence that it was implemented or informed a decision-making process. Papers describing routine applications of known methods are discouraged. Authors are encouraged to disclose all data and analyses thereof, and to provide computational code when appropriate. Editorial statements for the individual departments are provided below. Health Care Analytics Departmental Editors: Margrét Bjarnadóttir, University of Maryland Nan Kong, Purdue University With the explosion in computing power and available data, we have seen fast changes in the analytics applied in the healthcare space. The Health Care Analytics department welcomes papers applying a broad range of analytical approaches, including those rooted in machine learning, survival analysis, and complex event analysis, that allow healthcare professionals to find opportunities for improvement in health system management, patient engagement, spending, and diagnosis. We especially encourage papers that combine predictive and prescriptive analytics to improve decision making and health care outcomes. The contribution of papers can be across multiple dimensions including new methodology, novel modeling techniques and health care through real-world cohort studies. Papers that are methodologically focused need in addition to show practical relevance. Similarly papers that are application focused should clearly demonstrate improvements over the status quo and available approaches by applying rigorous analytics. Health Care Operations Management Departmental Editors: Nilay Tanik Argon, University of North Carolina at Chapel Hill Bob Batt, University of Wisconsin The department invites high-quality papers on the design, control, and analysis of operations at healthcare systems. We seek papers on classical operations management issues (such as scheduling, routing, queuing, transportation, patient flow, and quality) as well as non-traditional problems driven by everchanging healthcare practice. Empirical, experimental, and analytical (model based) methodologies are all welcome. Papers may draw theory from across disciplines, and should provide insight into improving operations from the perspective of patients, service providers, organizations (municipal/government/industry), and/or society. Health Care Management Science Practice Departmental Editor: Vikram Tiwari, Vanderbilt University Medical Center The department seeks research from academicians and practitioners that highlights Management Science based solutions directly relevant to the practice of healthcare. Relevance is judged by the impact on practice, as well as the degree to which researchers engaged with practitioners in understanding the problem context and in developing the solution. Validity, that is, the extent to which the results presented do or would apply in practice is a key evaluation criterion. In addition to meeting the journal’s standards of originality and substantial contribution to knowledge creation, research that can be replicated in other organizations is encouraged. Papers describing unsuccessful applied research projects may be considered if there are generalizable learning points addressing why the project was unsuccessful. Health Care Productivity Analysis Departmental Editor: Jonas Schreyögg, University of Hamburg The department invites papers with rigorous methods and significant impact for policy and practice. Papers typically apply theory and techniques to measuring productivity in health care organizations and systems. The journal welcomes state-of-the-art parametric as well as non-parametric techniques such as data envelopment analysis, stochastic frontier analysis or partial frontier analysis. The contribution of papers can be manifold including new methodology, novel combination of existing methods or application of existing methods to new contexts. Empirical papers should produce results generalizable beyond a selected set of health care organizations. All papers should include a section on implications for management or policy to enhance productivity. Public Health Policy and Medical Decision Making Departmental Editors: Ebru Bish, University of Alabama Julie L. Higle, University of Southern California The department invites high quality papers that use data-driven methods to address important problems that arise in public health policy and medical decision-making domains. We welcome submissions that develop and apply mathematical and computational models in support of data-driven and model-based analyses for these problems. The Public Health Policy and Medical Decision-Making Department is particularly interested in papers that: Study high-impact problems involving health policy, treatment planning and design, and clinical applications; Develop original data-driven models, including those that integrate disease modeling with screening and/or treatment guidelines; Use model-based analyses as decision making-tools to identify optimal solutions, insights, recommendations. Articles must clearly articulate the relevance of the work to decision and/or policy makers and the potential impact on patients and/or society. Papers will include articulated contributions within the methodological domain, which may include modeling, analytical, or computational methodologies. Emerging Topics Departmental Editor: Alec Morton, University of Strathclyde Emerging Topics will handle papers which use innovative quantitative methods to shed light on frontier issues in healthcare management and policy. Such papers may deal with analytic challenges arising from novel health technologies or new organizational forms. Papers falling under this department may also deal with the analysis of new forms of data which are increasingly captured as health systems become more and more digitized.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书