Development and external validation of a machine learning model for prediction of survival in undifferentiated pleomorphic sarcoma.

Q1 Medicine
MUSCULOSKELETAL SURGERY Pub Date : 2024-03-01 Epub Date: 2023-09-01 DOI:10.1007/s12306-023-00795-w
L Lee, T Yi, M Fice, R K Achar, C Jones, E Klein, N Buac, N Lopez-Hisijos, M W Colman, S Gitelis, A T Blank
{"title":"Development and external validation of a machine learning model for prediction of survival in undifferentiated pleomorphic sarcoma.","authors":"L Lee, T Yi, M Fice, R K Achar, C Jones, E Klein, N Buac, N Lopez-Hisijos, M W Colman, S Gitelis, A T Blank","doi":"10.1007/s12306-023-00795-w","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Machine learning (ML) algorithms to predict cancer survival have recently been reported for a number of sarcoma subtypes, but none have investigated undifferentiated pleomorphic sarcoma (UPS). ML is a powerful tool that has the potential to better prognosticate UPS.</p><p><strong>Methods: </strong>The Surveillance, Epidemiology, and End Results (SEER) database was queried for cases of histologically confirmed undifferentiated pleomorphic sarcoma (UPS) (n = 665). Patient, tumor, and treatment characteristics were recorded, and ML models were developed to predict 1-, 3-, and 5-year survival. The best performing ML model was externally validated using an institutional cohort of UPS patients (n = 151).</p><p><strong>Results: </strong>All ML models performed best at the 1-year time point and worst at the 5-year time point. On internal validation within the SEER cohort, the best models had c-statistics of 0.67-0.69 at the 5-year time point. The Multi-Layer Perceptron Neural Network (MLP) model was the best performing model and used for external validation. Similarly, the MLP model performed best at 1-year and worst at 5-year on external validation with c-statistics of 0.85 and 0.81, respectively. The MLP model was well calibrated on external validation. The MLP model has been made publicly available at https://rachar.shinyapps.io/ups_app/ .</p><p><strong>Conclusion: </strong>Machine learning models perform well for survival prediction in UPS, though this sarcoma subtype may be more difficult to prognosticate than other subtypes. Future studies are needed to further validate the machine learning approach for UPS prognostication.</p>","PeriodicalId":18875,"journal":{"name":"MUSCULOSKELETAL SURGERY","volume":" ","pages":"77-86"},"PeriodicalIF":0.0000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"MUSCULOSKELETAL SURGERY","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s12306-023-00795-w","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/9/1 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: Machine learning (ML) algorithms to predict cancer survival have recently been reported for a number of sarcoma subtypes, but none have investigated undifferentiated pleomorphic sarcoma (UPS). ML is a powerful tool that has the potential to better prognosticate UPS.

Methods: The Surveillance, Epidemiology, and End Results (SEER) database was queried for cases of histologically confirmed undifferentiated pleomorphic sarcoma (UPS) (n = 665). Patient, tumor, and treatment characteristics were recorded, and ML models were developed to predict 1-, 3-, and 5-year survival. The best performing ML model was externally validated using an institutional cohort of UPS patients (n = 151).

Results: All ML models performed best at the 1-year time point and worst at the 5-year time point. On internal validation within the SEER cohort, the best models had c-statistics of 0.67-0.69 at the 5-year time point. The Multi-Layer Perceptron Neural Network (MLP) model was the best performing model and used for external validation. Similarly, the MLP model performed best at 1-year and worst at 5-year on external validation with c-statistics of 0.85 and 0.81, respectively. The MLP model was well calibrated on external validation. The MLP model has been made publicly available at https://rachar.shinyapps.io/ups_app/ .

Conclusion: Machine learning models perform well for survival prediction in UPS, though this sarcoma subtype may be more difficult to prognosticate than other subtypes. Future studies are needed to further validate the machine learning approach for UPS prognostication.

用于预测未分化多形性肉瘤存活率的机器学习模型的开发和外部验证。
目的:最近有报道称,机器学习(ML)算法可预测多种肉瘤亚型的癌症生存率,但没有一种算法对未分化多形性肉瘤(UPS)进行过研究。ML是一种强大的工具,有可能更好地预测UPS的预后:方法:在监测、流行病学和最终结果(SEER)数据库中查询组织学确诊的未分化多形性肉瘤(UPS)病例(n = 665)。记录了患者、肿瘤和治疗特征,并开发了ML模型来预测1年、3年和5年生存率。结果显示,所有 ML 模型在 1 年、3 年和 5 年生存率方面表现最佳:结果:所有 ML 模型在 1 年时间点的表现最好,在 5 年时间点的表现最差。在 SEER 队列的内部验证中,最佳模型在 5 年时间点的 c 统计量为 0.67-0.69。多层感知器神经网络(MLP)模型是表现最好的模型,用于外部验证。同样,在外部验证中,MLP 模型在 1 年期表现最佳,在 5 年期表现最差,c 统计量分别为 0.85 和 0.81。MLP 模型在外部验证中校准良好。MLP 模型已在 https://rachar.shinyapps.io/ups_app/ 上公开:机器学习模型在预测 UPS 的生存率方面表现良好,尽管这种肉瘤亚型可能比其他亚型更难预后。未来的研究需要进一步验证机器学习方法对 UPS 预后的影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
MUSCULOSKELETAL SURGERY
MUSCULOSKELETAL SURGERY Medicine-Surgery
CiteScore
4.50
自引率
0.00%
发文量
35
期刊介绍: Musculoskeletal Surgery – Formerly La Chirurgia degli Organi di Movimento, founded in 1917 at the Istituto Ortopedico Rizzoli, is a peer-reviewed journal published three times a year. The journal provides up-to-date information to clinicians and scientists through the publication of original papers, reviews, case reports, and brief communications dealing with the pathogenesis and treatment of orthopaedic conditions.An electronic version is also available at http://www.springerlink.com.The journal is open for publication of supplements and for publishing abstracts of scientific meetings; conditions can be obtained from the Editors-in-Chief or the Publisher.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信