{"title":"Application of multimodal deep learning and multi-instance learning fusion techniques in predicting STN-DBS outcomes for Parkinson's disease patients.","authors":"Bowen Chang, Zhi Geng, Jiaming Mei, Zhengyu Wang, Peng Chen, Yuge Jiang, Chaoshi Niu","doi":"10.1016/j.neurot.2024.e00471","DOIUrl":null,"url":null,"abstract":"<p><p>Parkinson's Disease (PD) is a progressive neurodegenerative disorder with substantial impact on patients' quality of life. Subthalamic nucleus deep brain stimulation (STN-DBS) is an effective treatment for advanced PD, but patient responses vary, necessitating predictive models for personalized care. Recent advancements in medical imaging and machine learning offer opportunities to enhance predictive accuracy, particularly through deep learning and multi-instance learning (MIL) techniques. This retrospective study included 127 PD patients undergoing STN-DBS. Medical records and imaging data were collected, and patients were categorized based on treatment outcomes. Advanced segmentation models were trained for automated region of interest (ROI) delineation. A novel 2.5D deep learning approach incorporating multi-slice representation was developed to extract detailed ROI features. Multi-instance learning fusion techniques integrated predictions across multiple slices, combining radiomics and deep learning features to enhance model performance. Various machine learning algorithms were evaluated, and model robustness was assessed using cross-validation and hyperparameter optimization. The MIL model achieved an area under the curve (AUC) of 0.846 for predicting STN-DBS outcomes, surpassing the radiomics model's AUC of 0.825. Integration of MIL and radiomics features in the DLRad model further improved discriminative ability to an AUC of 0.871. Calibration tests showed good model reliability, and decision curve analysis demonstrated clinical utility, affirming the model's predictive advantage. This study demonstrates the efficacy of integrating MIL, radiomics, and deep learning techniques to predict STN-DBS outcomes in PD patients. The multimodal fusion approach enhances predictive accuracy, supporting personalized treatment planning and advancing patient care.</p>","PeriodicalId":19159,"journal":{"name":"Neurotherapeutics","volume":null,"pages":null},"PeriodicalIF":5.6000,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurotherapeutics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.neurot.2024.e00471","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/16 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Parkinson's Disease (PD) is a progressive neurodegenerative disorder with substantial impact on patients' quality of life. Subthalamic nucleus deep brain stimulation (STN-DBS) is an effective treatment for advanced PD, but patient responses vary, necessitating predictive models for personalized care. Recent advancements in medical imaging and machine learning offer opportunities to enhance predictive accuracy, particularly through deep learning and multi-instance learning (MIL) techniques. This retrospective study included 127 PD patients undergoing STN-DBS. Medical records and imaging data were collected, and patients were categorized based on treatment outcomes. Advanced segmentation models were trained for automated region of interest (ROI) delineation. A novel 2.5D deep learning approach incorporating multi-slice representation was developed to extract detailed ROI features. Multi-instance learning fusion techniques integrated predictions across multiple slices, combining radiomics and deep learning features to enhance model performance. Various machine learning algorithms were evaluated, and model robustness was assessed using cross-validation and hyperparameter optimization. The MIL model achieved an area under the curve (AUC) of 0.846 for predicting STN-DBS outcomes, surpassing the radiomics model's AUC of 0.825. Integration of MIL and radiomics features in the DLRad model further improved discriminative ability to an AUC of 0.871. Calibration tests showed good model reliability, and decision curve analysis demonstrated clinical utility, affirming the model's predictive advantage. This study demonstrates the efficacy of integrating MIL, radiomics, and deep learning techniques to predict STN-DBS outcomes in PD patients. The multimodal fusion approach enhances predictive accuracy, supporting personalized treatment planning and advancing patient care.
期刊介绍:
Neurotherapeutics® is the journal of the American Society for Experimental Neurotherapeutics (ASENT). Each issue provides critical reviews of an important topic relating to the treatment of neurological disorders written by international authorities.
The Journal also publishes original research articles in translational neuroscience including descriptions of cutting edge therapies that cross disciplinary lines and represent important contributions to neurotherapeutics for medical practitioners and other researchers in the field.
Neurotherapeutics ® delivers a multidisciplinary perspective on the frontiers of translational neuroscience, provides perspectives on current research and practice, and covers social and ethical as well as scientific issues.