Boning Tong, Zhuoping Zhou, Davoud Ataee Tarzanagh, Bojian Hou, Andrew J Saykin, Jason Moore, Marylyn Ritchie, Li Shen
{"title":"Class-Balanced Deep Learning with Adaptive Vector Scaling Loss for Dementia Stage Detection.","authors":"Boning Tong, Zhuoping Zhou, Davoud Ataee Tarzanagh, Bojian Hou, Andrew J Saykin, Jason Moore, Marylyn Ritchie, Li Shen","doi":"10.1007/978-3-031-45676-3_15","DOIUrl":null,"url":null,"abstract":"<p><p>Alzheimer's disease (AD) leads to irreversible cognitive decline, with Mild Cognitive Impairment (MCI) as its prodromal stage. Early detection of AD and related dementia is crucial for timely treatment and slowing disease progression. However, classifying cognitive normal (CN), MCI, and AD subjects using machine learning models faces class imbalance, necessitating the use of balanced accuracy as a suitable metric. To enhance model performance and balanced accuracy, we introduce a novel method called VS-Opt-Net. This approach incorporates the recently developed vector-scaling (VS) loss into a machine learning pipeline named STREAMLINE. Moreover, it employs Bayesian optimization for hyperparameter learning of both the model and loss function. VS-Opt-Net not only amplifies the contribution of minority examples in proportion to the imbalance level but also addresses the challenge of generalization in training deep networks. In our empirical study, we use MRI-based brain regional measurements as features to conduct the CN vs MCI and AD vs MCI binary classifications. We compare the balanced accuracy of our model with other machine learning models and deep neural network loss functions that also employ class-balanced strategies. Our findings demonstrate that after hyperparameter optimization, the deep neural network using the VS loss function substantially improves balanced accuracy. It also surpasses other models in performance on the AD dataset. Moreover, our feature importance analysis highlights VS-Opt-Net's ability to elucidate biomarker differences across dementia stages.</p>","PeriodicalId":74092,"journal":{"name":"Machine learning in medical imaging. MLMI (Workshop)","volume":"14349 ","pages":"144-154"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10924683/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Machine learning in medical imaging. MLMI (Workshop)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-45676-3_15","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/10/15 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Alzheimer's disease (AD) leads to irreversible cognitive decline, with Mild Cognitive Impairment (MCI) as its prodromal stage. Early detection of AD and related dementia is crucial for timely treatment and slowing disease progression. However, classifying cognitive normal (CN), MCI, and AD subjects using machine learning models faces class imbalance, necessitating the use of balanced accuracy as a suitable metric. To enhance model performance and balanced accuracy, we introduce a novel method called VS-Opt-Net. This approach incorporates the recently developed vector-scaling (VS) loss into a machine learning pipeline named STREAMLINE. Moreover, it employs Bayesian optimization for hyperparameter learning of both the model and loss function. VS-Opt-Net not only amplifies the contribution of minority examples in proportion to the imbalance level but also addresses the challenge of generalization in training deep networks. In our empirical study, we use MRI-based brain regional measurements as features to conduct the CN vs MCI and AD vs MCI binary classifications. We compare the balanced accuracy of our model with other machine learning models and deep neural network loss functions that also employ class-balanced strategies. Our findings demonstrate that after hyperparameter optimization, the deep neural network using the VS loss function substantially improves balanced accuracy. It also surpasses other models in performance on the AD dataset. Moreover, our feature importance analysis highlights VS-Opt-Net's ability to elucidate biomarker differences across dementia stages.
阿尔茨海默病(AD)会导致不可逆的认知能力下降,轻度认知障碍(MCI)是其前驱阶段。早期发现阿尔茨海默病和相关痴呆症对于及时治疗和延缓疾病进展至关重要。然而,使用机器学习模型对认知正常(CN)、MCI 和 AD 受试者进行分类面临着类别不平衡的问题,因此有必要使用平衡准确性作为合适的衡量标准。为了提高模型性能和平衡准确性,我们引入了一种名为 VS-Opt-Net 的新方法。这种方法将最近开发的向量缩放(VS)损失纳入名为 STREAMLINE 的机器学习管道中。此外,它还采用贝叶斯优化方法对模型和损失函数进行超参数学习。VS-Opt-Net 不仅能根据不平衡程度放大少数实例的贡献,还能解决深度网络训练中的泛化难题。在实证研究中,我们使用基于 MRI 的大脑区域测量作为特征,进行 CN vs MCI 和 AD vs MCI 的二元分类。我们将模型的平衡准确性与其他同样采用类平衡策略的机器学习模型和深度神经网络损失函数进行了比较。我们的研究结果表明,经过超参数优化后,使用 VS 损失函数的深度神经网络大大提高了均衡准确率。它在 AD 数据集上的表现也超过了其他模型。此外,我们的特征重要性分析突出了 VS-Opt-Net 在阐明不同痴呆症阶段的生物标记物差异方面的能力。