Louise C Yates, Elliot Yates, Xuanxuan Li, Yiping Lu, Kamal Yakoub, David Davies, Antonio Belli, Vijay Sawlani
{"title":"Developing a multivariate model for the prediction of concussion recovery in sportspeople: a machine learning approach.","authors":"Louise C Yates, Elliot Yates, Xuanxuan Li, Yiping Lu, Kamal Yakoub, David Davies, Antonio Belli, Vijay Sawlani","doi":"10.1136/bmjsem-2024-002090","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Sportspeople suffering from mild traumatic brain injury (mTBI) who return prematurely to sport are at an increased risk of delayed recovery, repeat concussion events and, in the longer-term, the development of chronic traumatic encephalopathy. Therefore, determining the appropriate recovery time, without unnecessarily delaying return to sport, is paramount at a professional/semi-professional level, yet notoriously difficult to predict.</p><p><strong>Objectives: </strong>To use machine learning to develop a multivariate model for the prediction of concussion recovery in sportspeople.</p><p><strong>Methods: </strong>Demographics, injury history, Sport Concussion Assessment Tool fifth edition questionnaire and MRI head reports were collected for sportspeople who suffered mTBI and were referred to a tertiary university hospital in the West Midlands over 3 years. Random forest (RF) machine learning algorithms were trained and tuned on a 90% outcome-balanced corpus subset, with subsequent validation testing on the previously unseen 10% subset for binary prediction of greater than five missed sporting games. Confusion matrices and receiver operator curves were used to determine model discrimination.</p><p><strong>Results: </strong>375 sportspeople were included. A final composite model accuracy of 94.6% based on the unseen testing subset was obtained, yielding a sensitivity of 100% and specificity of 93.8% with a positive predictive value of 71.4% and a negative predictive value of 100%. The area under the curve was 96.3%.</p><p><strong>Discussion: </strong>In this large single-centre cohort study, a composite RF machine learning algorithm demonstrated high performance in predicting sporting games missed post-mTBI injury. Validation of this novel model on larger external datasets is therefore warranted.</p><p><strong>Trial registration number: </strong>ISRCTN16974791.</p>","PeriodicalId":47417,"journal":{"name":"BMJ Open Sport & Exercise Medicine","volume":"11 1","pages":"e002090"},"PeriodicalIF":3.9000,"publicationDate":"2025-03-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11934374/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Open Sport & Exercise Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjsem-2024-002090","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"SPORT SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Sportspeople suffering from mild traumatic brain injury (mTBI) who return prematurely to sport are at an increased risk of delayed recovery, repeat concussion events and, in the longer-term, the development of chronic traumatic encephalopathy. Therefore, determining the appropriate recovery time, without unnecessarily delaying return to sport, is paramount at a professional/semi-professional level, yet notoriously difficult to predict.
Objectives: To use machine learning to develop a multivariate model for the prediction of concussion recovery in sportspeople.
Methods: Demographics, injury history, Sport Concussion Assessment Tool fifth edition questionnaire and MRI head reports were collected for sportspeople who suffered mTBI and were referred to a tertiary university hospital in the West Midlands over 3 years. Random forest (RF) machine learning algorithms were trained and tuned on a 90% outcome-balanced corpus subset, with subsequent validation testing on the previously unseen 10% subset for binary prediction of greater than five missed sporting games. Confusion matrices and receiver operator curves were used to determine model discrimination.
Results: 375 sportspeople were included. A final composite model accuracy of 94.6% based on the unseen testing subset was obtained, yielding a sensitivity of 100% and specificity of 93.8% with a positive predictive value of 71.4% and a negative predictive value of 100%. The area under the curve was 96.3%.
Discussion: In this large single-centre cohort study, a composite RF machine learning algorithm demonstrated high performance in predicting sporting games missed post-mTBI injury. Validation of this novel model on larger external datasets is therefore warranted.