Prediction of Effectiveness and Toxicities of Immune Checkpoint Inhibitors Using Real-World Patient Data.

IF 3.3 Q2 ONCOLOGY
Levente Lippenszky, Kathleen F Mittendorf, Zoltán Kiss, Michele L LeNoue-Newton, Pablo Napan-Molina, Protiva Rahman, Cheng Ye, Balázs Laczi, Eszter Csernai, Neha M Jain, Marilyn E Holt, Christina N Maxwell, Madeleine Ball, Yufang Ma, Margaret B Mitchell, Douglas B Johnson, David S Smith, Ben H Park, Christine M Micheel, Daniel Fabbri, Jan Wolber, Travis J Osterman
{"title":"Prediction of Effectiveness and Toxicities of Immune Checkpoint Inhibitors Using Real-World Patient Data.","authors":"Levente Lippenszky, Kathleen F Mittendorf, Zoltán Kiss, Michele L LeNoue-Newton, Pablo Napan-Molina, Protiva Rahman, Cheng Ye, Balázs Laczi, Eszter Csernai, Neha M Jain, Marilyn E Holt, Christina N Maxwell, Madeleine Ball, Yufang Ma, Margaret B Mitchell, Douglas B Johnson, David S Smith, Ben H Park, Christine M Micheel, Daniel Fabbri, Jan Wolber, Travis J Osterman","doi":"10.1200/CCI.23.00207","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Although immune checkpoint inhibitors (ICIs) have improved outcomes in certain patients with cancer, they can also cause life-threatening immunotoxicities. Predicting immunotoxicity risks alongside response could provide a personalized risk-benefit profile, inform therapeutic decision making, and improve clinical trial cohort selection. We aimed to build a machine learning (ML) framework using routine electronic health record (EHR) data to predict hepatitis, colitis, pneumonitis, and 1-year overall survival.</p><p><strong>Methods: </strong>Real-world EHR data of more than 2,200 patients treated with ICI through December 31, 2018, were used to develop predictive models. Using a prediction time point of ICI initiation, a 1-year prediction time window was applied to create binary labels for the four outcomes for each patient. Feature engineering involved aggregating laboratory measurements over appropriate time windows (60-365 days). Patients were randomly partitioned into training (80%) and test (20%) sets. Random forest classifiers were developed using a rigorous model development framework.</p><p><strong>Results: </strong>The patient cohort had a median age of 63 years and was 61.8% male. Patients predominantly had melanoma (37.8%), lung cancer (27.3%), or genitourinary cancer (16.4%). They were treated with PD-1 (60.4%), PD-L1 (9.0%), and CTLA-4 (19.7%) ICIs. Our models demonstrate reasonably strong performance, with AUCs of 0.739, 0.729, 0.755, and 0.752 for the pneumonitis, hepatitis, colitis, and 1-year overall survival models, respectively. Each model relies on an outcome-specific feature set, though some features are shared among models.</p><p><strong>Conclusion: </strong>To our knowledge, this is the first ML solution that assesses individual ICI risk-benefit profiles based predominantly on routine structured EHR data. As such, use of our ML solution will not require additional data collection or documentation in the clinic.</p>","PeriodicalId":51626,"journal":{"name":"JCO Clinical Cancer Informatics","volume":null,"pages":null},"PeriodicalIF":3.3000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10919473/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JCO Clinical Cancer Informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1200/CCI.23.00207","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: Although immune checkpoint inhibitors (ICIs) have improved outcomes in certain patients with cancer, they can also cause life-threatening immunotoxicities. Predicting immunotoxicity risks alongside response could provide a personalized risk-benefit profile, inform therapeutic decision making, and improve clinical trial cohort selection. We aimed to build a machine learning (ML) framework using routine electronic health record (EHR) data to predict hepatitis, colitis, pneumonitis, and 1-year overall survival.

Methods: Real-world EHR data of more than 2,200 patients treated with ICI through December 31, 2018, were used to develop predictive models. Using a prediction time point of ICI initiation, a 1-year prediction time window was applied to create binary labels for the four outcomes for each patient. Feature engineering involved aggregating laboratory measurements over appropriate time windows (60-365 days). Patients were randomly partitioned into training (80%) and test (20%) sets. Random forest classifiers were developed using a rigorous model development framework.

Results: The patient cohort had a median age of 63 years and was 61.8% male. Patients predominantly had melanoma (37.8%), lung cancer (27.3%), or genitourinary cancer (16.4%). They were treated with PD-1 (60.4%), PD-L1 (9.0%), and CTLA-4 (19.7%) ICIs. Our models demonstrate reasonably strong performance, with AUCs of 0.739, 0.729, 0.755, and 0.752 for the pneumonitis, hepatitis, colitis, and 1-year overall survival models, respectively. Each model relies on an outcome-specific feature set, though some features are shared among models.

Conclusion: To our knowledge, this is the first ML solution that assesses individual ICI risk-benefit profiles based predominantly on routine structured EHR data. As such, use of our ML solution will not require additional data collection or documentation in the clinic.

利用真实世界的患者数据预测免疫检查点抑制剂的有效性和毒性。
目的:尽管免疫检查点抑制剂(ICIs)改善了某些癌症患者的治疗效果,但它们也可能导致危及生命的免疫毒性。预测免疫毒性风险和反应可提供个性化的风险-效益概况,为治疗决策提供信息,并改善临床试验队列的选择。我们旨在利用常规电子健康记录(EHR)数据建立一个机器学习(ML)框架,以预测肝炎、结肠炎、肺炎和1年总生存期:截至 2018 年 12 月 31 日,使用 ICI 治疗的 2200 多名患者的真实 EHR 数据被用于开发预测模型。使用 ICI 启动的预测时间点,应用 1 年的预测时间窗为每位患者的四种结果创建二进制标签。特征工程包括在适当的时间窗(60-365 天)内汇总实验室测量结果。患者被随机分为训练集(80%)和测试集(20%)。使用严格的模型开发框架开发随机森林分类器:患者群的中位年龄为 63 岁,61.8% 为男性。患者主要患有黑色素瘤(37.8%)、肺癌(27.3%)或泌尿生殖系统癌症(16.4%)。他们接受了 PD-1(60.4%)、PD-L1(9.0%)和 CTLA-4 (19.7%) ICIs 治疗。我们的模型表现出相当强的性能,肺炎、肝炎、结肠炎和 1 年总生存期模型的 AUC 分别为 0.739、0.729、0.755 和 0.752。每个模型都依赖于特定结果的特征集,尽管模型之间共享某些特征:据我们所知,这是首个主要基于常规结构化电子病历数据评估个体 ICI 风险-效益概况的 ML 解决方案。因此,使用我们的 ML 解决方案无需在临床中进行额外的数据收集或记录。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.20
自引率
4.80%
发文量
190
文献相关原料
公司名称 产品信息 采购帮参考价格
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信