Armin Birner, Marco Mairinger, Clemens Elst, Alexander Maget, Frederike T. Fellendorf, Martina Platzer, Robert Queissner, Melanie Lenger, Adelina Tmava-Berisha, Susanne A. Bengesser, Eva Z. Reininghaus, Markus Kreuzthaler, Nina Dalkner
{"title":"基于机器的双相情感障碍多维数据学习--试验结果。","authors":"Armin Birner, Marco Mairinger, Clemens Elst, Alexander Maget, Frederike T. Fellendorf, Martina Platzer, Robert Queissner, Melanie Lenger, Adelina Tmava-Berisha, Susanne A. Bengesser, Eva Z. Reininghaus, Markus Kreuzthaler, Nina Dalkner","doi":"10.1111/bdi.13426","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Introduction</h3>\n \n <p>Owing to the heterogenic picture of bipolar disorder, it takes approximately 8.8 years to reach a correct diagnosis. Early recognition and early intervention might not only increase quality of life, but also increase life expectancy as a whole in individuals with bipolar disorder. Therefore, we hypothesize that implementing machine learning techniques can be used to support the diagnostic process of bipolar disorder and minimize misdiagnosis rates.</p>\n </section>\n \n <section>\n \n <h3> Materials and Methods</h3>\n \n <p>To test this hypothesis, a de-identified data set of only demographic information and the results of cognitive tests of 196 patients with bipolar disorder and 145 healthy controls was used to train and compare five different machine learning algorithms.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>The best performing algorithm was logistic regression, with a macro-average F1-score of 0.69 [95% CI 0.66–0.73]. After further optimization, a model with an improved macro-average F1-score of 0.75, a micro-average F1-score of 0.77, and an AUROC of 0.84 was built. Furthermore, the individual amount of contribution per variable on the classification was assessed, which revealed that body mass index, results of the Stroop test, and the d2-R test alone allow for a classification of bipolar disorder with equal performance.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>Using these data for clinical application results in an acceptable performance, but has not yet reached a state where it can sufficiently augment a diagnosis made by an experienced clinician. Therefore, further research should focus on identifying variables with the highest amount of contribution to a model's classification.</p>\n </section>\n </div>","PeriodicalId":8959,"journal":{"name":"Bipolar Disorders","volume":"26 4","pages":"364-375"},"PeriodicalIF":5.0000,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bdi.13426","citationCount":"0","resultStr":"{\"title\":\"Machine-based learning of multidimensional data in bipolar disorder – pilot results\",\"authors\":\"Armin Birner, Marco Mairinger, Clemens Elst, Alexander Maget, Frederike T. Fellendorf, Martina Platzer, Robert Queissner, Melanie Lenger, Adelina Tmava-Berisha, Susanne A. Bengesser, Eva Z. Reininghaus, Markus Kreuzthaler, Nina Dalkner\",\"doi\":\"10.1111/bdi.13426\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Introduction</h3>\\n \\n <p>Owing to the heterogenic picture of bipolar disorder, it takes approximately 8.8 years to reach a correct diagnosis. Early recognition and early intervention might not only increase quality of life, but also increase life expectancy as a whole in individuals with bipolar disorder. Therefore, we hypothesize that implementing machine learning techniques can be used to support the diagnostic process of bipolar disorder and minimize misdiagnosis rates.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Materials and Methods</h3>\\n \\n <p>To test this hypothesis, a de-identified data set of only demographic information and the results of cognitive tests of 196 patients with bipolar disorder and 145 healthy controls was used to train and compare five different machine learning algorithms.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results</h3>\\n \\n <p>The best performing algorithm was logistic regression, with a macro-average F1-score of 0.69 [95% CI 0.66–0.73]. After further optimization, a model with an improved macro-average F1-score of 0.75, a micro-average F1-score of 0.77, and an AUROC of 0.84 was built. Furthermore, the individual amount of contribution per variable on the classification was assessed, which revealed that body mass index, results of the Stroop test, and the d2-R test alone allow for a classification of bipolar disorder with equal performance.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusion</h3>\\n \\n <p>Using these data for clinical application results in an acceptable performance, but has not yet reached a state where it can sufficiently augment a diagnosis made by an experienced clinician. Therefore, further research should focus on identifying variables with the highest amount of contribution to a model's classification.</p>\\n </section>\\n </div>\",\"PeriodicalId\":8959,\"journal\":{\"name\":\"Bipolar Disorders\",\"volume\":\"26 4\",\"pages\":\"364-375\"},\"PeriodicalIF\":5.0000,\"publicationDate\":\"2024-03-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/bdi.13426\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Bipolar Disorders\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/bdi.13426\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Bipolar Disorders","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/bdi.13426","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
摘要
引言由于双相情感障碍的病因复杂,正确诊断大约需要 8.8 年的时间。早期识别和早期干预不仅能提高生活质量,还能延长躁郁症患者的预期寿命。因此,我们假设可以利用机器学习技术来支持双相情感障碍的诊断过程,并将误诊率降到最低:为了验证这一假设,我们使用了一个去身份化的数据集,该数据集仅包含 196 名双相情感障碍患者和 145 名健康对照者的人口统计学信息和认知测试结果,用于训练和比较五种不同的机器学习算法:结果:表现最好的算法是逻辑回归,宏观平均 F1 分数为 0.69 [95% CI 0.66-0.73]。经过进一步优化,建立的模型宏观平均 F1 分数提高到 0.75,微观平均 F1 分数提高到 0.77,AUROC 提高到 0.84。此外,还评估了每个变量对分类的贡献,结果显示,仅体重指数、Stroop 测试结果和 d2-R 测试结果就能对双相情感障碍进行分类,且性能相当:结论:将这些数据用于临床应用的结果是可以接受的,但还没有达到能够充分增强有经验的临床医生所做诊断的程度。因此,进一步的研究应侧重于确定对模型分类贡献最大的变量。
Machine-based learning of multidimensional data in bipolar disorder – pilot results
Introduction
Owing to the heterogenic picture of bipolar disorder, it takes approximately 8.8 years to reach a correct diagnosis. Early recognition and early intervention might not only increase quality of life, but also increase life expectancy as a whole in individuals with bipolar disorder. Therefore, we hypothesize that implementing machine learning techniques can be used to support the diagnostic process of bipolar disorder and minimize misdiagnosis rates.
Materials and Methods
To test this hypothesis, a de-identified data set of only demographic information and the results of cognitive tests of 196 patients with bipolar disorder and 145 healthy controls was used to train and compare five different machine learning algorithms.
Results
The best performing algorithm was logistic regression, with a macro-average F1-score of 0.69 [95% CI 0.66–0.73]. After further optimization, a model with an improved macro-average F1-score of 0.75, a micro-average F1-score of 0.77, and an AUROC of 0.84 was built. Furthermore, the individual amount of contribution per variable on the classification was assessed, which revealed that body mass index, results of the Stroop test, and the d2-R test alone allow for a classification of bipolar disorder with equal performance.
Conclusion
Using these data for clinical application results in an acceptable performance, but has not yet reached a state where it can sufficiently augment a diagnosis made by an experienced clinician. Therefore, further research should focus on identifying variables with the highest amount of contribution to a model's classification.
期刊介绍:
Bipolar Disorders is an international journal that publishes all research of relevance for the basic mechanisms, clinical aspects, or treatment of bipolar disorders and related illnesses. It intends to provide a single international outlet for new research in this area and covers research in the following areas:
biochemistry
physiology
neuropsychopharmacology
neuroanatomy
neuropathology
genetics
brain imaging
epidemiology
phenomenology
clinical aspects
and therapeutics of bipolar disorders
Bipolar Disorders also contains papers that form the development of new therapeutic strategies for these disorders as well as papers on the topics of schizoaffective disorders, and depressive disorders as these can be cyclic disorders with areas of overlap with bipolar disorders.
The journal will consider for publication submissions within the domain of: Perspectives, Research Articles, Correspondence, Clinical Corner, and Reflections. Within these there are a number of types of articles: invited editorials, debates, review articles, original articles, commentaries, letters to the editors, clinical conundrums, clinical curiosities, clinical care, and musings.