Aoyu Li, Jingwen Li, Yishan Hu, Yan Geng, Yan Qiang, Juanjuan Zhao
{"title":"无创轻度认知障碍检测的动态自适应集成学习框架:开发与验证研究。","authors":"Aoyu Li, Jingwen Li, Yishan Hu, Yan Geng, Yan Qiang, Juanjuan Zhao","doi":"10.2196/60250","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The prompt and accurate identification of mild cognitive impairment (MCI) is crucial for preventing its progression into more severe neurodegenerative diseases. However, current diagnostic solutions, such as biomarkers and cognitive screening tests, prove costly, time-consuming, and invasive, hindering patient compliance and the accessibility of these tests. Therefore, exploring a more cost-effective, efficient, and noninvasive method to aid clinicians in detecting MCI is necessary.</p><p><strong>Objective: </strong>This study aims to develop an ensemble learning framework that adaptively integrates multimodal physiological data collected from wearable wristbands and digital cognitive metrics recorded on tablets, thereby improving the accuracy and practicality of MCI detection.</p><p><strong>Methods: </strong>We recruited 843 participants aged 60 years and older from the geriatrics and neurology departments of our collaborating hospitals, who were randomly divided into a development dataset (674/843 participants) and an internal test dataset (169/843 participants) at a 4:1 ratio. In addition, 226 older adults were recruited from 3 external centers to form an external test dataset. We measured their physiological signals (eg, electrodermal activity and photoplethysmography) and digital cognitive parameters (eg, reaction time and test scores) using the clinically certified Empatica 4 wristband and a tablet cognitive screening tool. The collected data underwent rigorous preprocessing, during which features in the time, frequency, and nonlinear domains were extracted from individual physiological signals. To address the challenges (eg, the curse of dimensionality and increased model complexity) posed by high-dimensional features, we developed a dynamic adaptive feature selection optimization algorithm to identify the most impactful subset of features for classification performance. Finally, the accuracy and efficiency of the classification model were improved by optimizing the combination of base learners.</p><p><strong>Results: </strong>The experimental results indicate that the proposed MCI detection framework achieved classification accuracies of 88.4%, 85.5%, and 84.5% on the development, internal test, and external test datasets, respectively. The area under the curve for the binary classification task was 0.945 (95% CI 0.903-0.986), 0.912 (95% CI 0.859-0.965), and 0.904 (95% CI 0.846-0.962) on these datasets. Furthermore, a statistical analysis of feature subsets during the iterative modeling process revealed that the decay time of skin conductance response, the percentage of continuous normal-to-normal intervals exceeding 50 milliseconds, the ratio of low-frequency to high-frequency (LF/HF) components in heart rate variability, and cognitive time features emerged as the most prevalent and effective indicators. Specifically, compared with healthy individuals, patients with MCI exhibited a longer skin conductance response decay time during cognitive testing (P<.001), a lower percentage of continuous normal-to-normal intervals exceeding 50 milliseconds (P<.001), and higher LF/HF (P<.001), accompanied by greater variability. Similarly, patients with MCI took longer to complete cognitive tests than healthy individuals (P<.001).</p><p><strong>Conclusions: </strong>The developed MCI detection framework has demonstrated exemplary performance and stability in large-scale validations. It establishes a new benchmark for noninvasive, effective early MCI detection that can be integrated into routine wearable and tablet-based assessments. Furthermore, the framework enables continuous and convenient self-screening within home or nonspecialized settings, effectively mitigating underresourced health care and geographic location constraints, making it an essential tool in the current fight against neurodegenerative diseases.</p>","PeriodicalId":56334,"journal":{"name":"JMIR Medical Informatics","volume":"13 ","pages":"e60250"},"PeriodicalIF":3.1000,"publicationDate":"2025-01-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study.\",\"authors\":\"Aoyu Li, Jingwen Li, Yishan Hu, Yan Geng, Yan Qiang, Juanjuan Zhao\",\"doi\":\"10.2196/60250\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>The prompt and accurate identification of mild cognitive impairment (MCI) is crucial for preventing its progression into more severe neurodegenerative diseases. However, current diagnostic solutions, such as biomarkers and cognitive screening tests, prove costly, time-consuming, and invasive, hindering patient compliance and the accessibility of these tests. Therefore, exploring a more cost-effective, efficient, and noninvasive method to aid clinicians in detecting MCI is necessary.</p><p><strong>Objective: </strong>This study aims to develop an ensemble learning framework that adaptively integrates multimodal physiological data collected from wearable wristbands and digital cognitive metrics recorded on tablets, thereby improving the accuracy and practicality of MCI detection.</p><p><strong>Methods: </strong>We recruited 843 participants aged 60 years and older from the geriatrics and neurology departments of our collaborating hospitals, who were randomly divided into a development dataset (674/843 participants) and an internal test dataset (169/843 participants) at a 4:1 ratio. In addition, 226 older adults were recruited from 3 external centers to form an external test dataset. We measured their physiological signals (eg, electrodermal activity and photoplethysmography) and digital cognitive parameters (eg, reaction time and test scores) using the clinically certified Empatica 4 wristband and a tablet cognitive screening tool. The collected data underwent rigorous preprocessing, during which features in the time, frequency, and nonlinear domains were extracted from individual physiological signals. To address the challenges (eg, the curse of dimensionality and increased model complexity) posed by high-dimensional features, we developed a dynamic adaptive feature selection optimization algorithm to identify the most impactful subset of features for classification performance. Finally, the accuracy and efficiency of the classification model were improved by optimizing the combination of base learners.</p><p><strong>Results: </strong>The experimental results indicate that the proposed MCI detection framework achieved classification accuracies of 88.4%, 85.5%, and 84.5% on the development, internal test, and external test datasets, respectively. The area under the curve for the binary classification task was 0.945 (95% CI 0.903-0.986), 0.912 (95% CI 0.859-0.965), and 0.904 (95% CI 0.846-0.962) on these datasets. Furthermore, a statistical analysis of feature subsets during the iterative modeling process revealed that the decay time of skin conductance response, the percentage of continuous normal-to-normal intervals exceeding 50 milliseconds, the ratio of low-frequency to high-frequency (LF/HF) components in heart rate variability, and cognitive time features emerged as the most prevalent and effective indicators. Specifically, compared with healthy individuals, patients with MCI exhibited a longer skin conductance response decay time during cognitive testing (P<.001), a lower percentage of continuous normal-to-normal intervals exceeding 50 milliseconds (P<.001), and higher LF/HF (P<.001), accompanied by greater variability. Similarly, patients with MCI took longer to complete cognitive tests than healthy individuals (P<.001).</p><p><strong>Conclusions: </strong>The developed MCI detection framework has demonstrated exemplary performance and stability in large-scale validations. It establishes a new benchmark for noninvasive, effective early MCI detection that can be integrated into routine wearable and tablet-based assessments. Furthermore, the framework enables continuous and convenient self-screening within home or nonspecialized settings, effectively mitigating underresourced health care and geographic location constraints, making it an essential tool in the current fight against neurodegenerative diseases.</p>\",\"PeriodicalId\":56334,\"journal\":{\"name\":\"JMIR Medical Informatics\",\"volume\":\"13 \",\"pages\":\"e60250\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-01-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"JMIR Medical Informatics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.2196/60250\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MEDICAL INFORMATICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.2196/60250","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0
摘要
背景:及时准确地识别轻度认知障碍(MCI)对于防止其发展为更严重的神经退行性疾病至关重要。然而,目前的诊断解决方案,如生物标志物和认知筛查测试,证明是昂贵、耗时和侵入性的,阻碍了患者的依从性和这些测试的可及性。因此,探索一种更具成本效益、效率和非侵入性的方法来帮助临床医生检测MCI是必要的。目的:本研究旨在开发一个集成学习框架,自适应整合可穿戴腕带采集的多模态生理数据和平板电脑记录的数字认知指标,从而提高MCI检测的准确性和实用性。方法:从合作医院老年病学和神经内科招募60岁及以上的参与者843人,按4:1的比例随机分为开发数据集(674/843)和内部测试数据集(169/843)。此外,从3个外部中心招募226名老年人形成外部测试数据集。我们使用临床认证的Empatica 4腕带和平板电脑认知筛查工具测量了他们的生理信号(如皮电活动和光体积脉搏波)和数字认知参数(如反应时间和测试分数)。采集到的数据经过严格的预处理,提取个体生理信号的时间、频率和非线性域特征。为了解决高维特征带来的挑战(例如,维度的诅咒和模型复杂性的增加),我们开发了一种动态自适应特征选择优化算法来识别对分类性能最有影响的特征子集。最后,通过对基学习器组合的优化,提高了分类模型的准确率和效率。结果:实验结果表明,所提出的MCI检测框架在开发、内部测试和外部测试数据集上的分类准确率分别为88.4%、85.5%和84.5%。在这些数据集上,二元分类任务的曲线下面积分别为0.945 (95% CI 0.903-0.986)、0.912 (95% CI 0.859-0.965)和0.904 (95% CI 0.846-0.962)。此外,对迭代建模过程中特征子集的统计分析表明,皮肤电导响应的衰减时间、连续正常到正常间隔超过50毫秒的百分比、心率变异性中低频与高频(LF/HF)分量的比例以及认知时间特征是最普遍和最有效的指标。具体来说,与健康个体相比,MCI患者在认知测试中表现出更长的皮肤电导反应衰减时间(p结论:开发的MCI检测框架在大规模验证中表现出示范性的性能和稳定性。它为无创、有效的早期MCI检测建立了一个新的基准,可以整合到常规的可穿戴和平板电脑评估中。此外,该框架能够在家庭或非专业环境中进行持续和方便的自我筛查,有效缓解资源不足的卫生保健和地理位置限制,使其成为当前防治神经退行性疾病的重要工具。
A Dynamic Adaptive Ensemble Learning Framework for Noninvasive Mild Cognitive Impairment Detection: Development and Validation Study.
Background: The prompt and accurate identification of mild cognitive impairment (MCI) is crucial for preventing its progression into more severe neurodegenerative diseases. However, current diagnostic solutions, such as biomarkers and cognitive screening tests, prove costly, time-consuming, and invasive, hindering patient compliance and the accessibility of these tests. Therefore, exploring a more cost-effective, efficient, and noninvasive method to aid clinicians in detecting MCI is necessary.
Objective: This study aims to develop an ensemble learning framework that adaptively integrates multimodal physiological data collected from wearable wristbands and digital cognitive metrics recorded on tablets, thereby improving the accuracy and practicality of MCI detection.
Methods: We recruited 843 participants aged 60 years and older from the geriatrics and neurology departments of our collaborating hospitals, who were randomly divided into a development dataset (674/843 participants) and an internal test dataset (169/843 participants) at a 4:1 ratio. In addition, 226 older adults were recruited from 3 external centers to form an external test dataset. We measured their physiological signals (eg, electrodermal activity and photoplethysmography) and digital cognitive parameters (eg, reaction time and test scores) using the clinically certified Empatica 4 wristband and a tablet cognitive screening tool. The collected data underwent rigorous preprocessing, during which features in the time, frequency, and nonlinear domains were extracted from individual physiological signals. To address the challenges (eg, the curse of dimensionality and increased model complexity) posed by high-dimensional features, we developed a dynamic adaptive feature selection optimization algorithm to identify the most impactful subset of features for classification performance. Finally, the accuracy and efficiency of the classification model were improved by optimizing the combination of base learners.
Results: The experimental results indicate that the proposed MCI detection framework achieved classification accuracies of 88.4%, 85.5%, and 84.5% on the development, internal test, and external test datasets, respectively. The area under the curve for the binary classification task was 0.945 (95% CI 0.903-0.986), 0.912 (95% CI 0.859-0.965), and 0.904 (95% CI 0.846-0.962) on these datasets. Furthermore, a statistical analysis of feature subsets during the iterative modeling process revealed that the decay time of skin conductance response, the percentage of continuous normal-to-normal intervals exceeding 50 milliseconds, the ratio of low-frequency to high-frequency (LF/HF) components in heart rate variability, and cognitive time features emerged as the most prevalent and effective indicators. Specifically, compared with healthy individuals, patients with MCI exhibited a longer skin conductance response decay time during cognitive testing (P<.001), a lower percentage of continuous normal-to-normal intervals exceeding 50 milliseconds (P<.001), and higher LF/HF (P<.001), accompanied by greater variability. Similarly, patients with MCI took longer to complete cognitive tests than healthy individuals (P<.001).
Conclusions: The developed MCI detection framework has demonstrated exemplary performance and stability in large-scale validations. It establishes a new benchmark for noninvasive, effective early MCI detection that can be integrated into routine wearable and tablet-based assessments. Furthermore, the framework enables continuous and convenient self-screening within home or nonspecialized settings, effectively mitigating underresourced health care and geographic location constraints, making it an essential tool in the current fight against neurodegenerative diseases.
期刊介绍:
JMIR Medical Informatics (JMI, ISSN 2291-9694) is a top-rated, tier A journal which focuses on clinical informatics, big data in health and health care, decision support for health professionals, electronic health records, ehealth infrastructures and implementation. It has a focus on applied, translational research, with a broad readership including clinicians, CIOs, engineers, industry and health informatics professionals.
Published by JMIR Publications, publisher of the Journal of Medical Internet Research (JMIR), the leading eHealth/mHealth journal (Impact Factor 2016: 5.175), JMIR Med Inform has a slightly different scope (emphasizing more on applications for clinicians and health professionals rather than consumers/citizens, which is the focus of JMIR), publishes even faster, and also allows papers which are more technical or more formative than what would be published in the Journal of Medical Internet Research.