通过自监督对比学习自动量化 COVID-19 肺水肿

Zhaohui Liang, Zhiyun Xue, Sivaramakrishnan Rajaraman, Yang Feng, Sameer Antani
{"title":"通过自监督对比学习自动量化 COVID-19 肺水肿","authors":"Zhaohui Liang, Zhiyun Xue, Sivaramakrishnan Rajaraman, Yang Feng, Sameer Antani","doi":"10.1007/978-3-031-44917-8_12","DOIUrl":null,"url":null,"abstract":"<p><p>We proposed a self-supervised machine learning method to automatically rate the severity of pulmonary edema in the frontal chest X-ray radiographs (CXR) which could be potentially related to COVID-19 viral pneumonia. For this we use the modified radiographic assessment of lung edema (mRALE) scoring system. The new model was first optimized with the simple Siamese network (SimSiam) architecture where a ResNet-50 pretrained by ImageNet database was used as the backbone. The encoder projected a 2048-dimension embedding as representation features to a downstream fully connected deep neural network for mRALE score prediction. A 5-fold cross-validation with 2,599 frontal CXRs was used to examine the new model's performance with comparison to a non-pretrained SimSiam encoder and a ResNet-50 trained from scratch. The mean absolute error (MAE) of the new model is 5.05 (95%CI 5.03-5.08), the mean squared error (MSE) is 66.67 (95%CI 66.29-67.06), and the Spearman's correlation coefficient (Spearman ρ) to the expert-annotated scores is 0.77 (95%CI 0.75-0.79). All the performance metrics of the new model are superior to the two comparators (P<0.01), and the scores of MSE and Spearman ρ of the two comparators have no statistical difference (P>0.05). The model also achieved a prediction probability concordance of 0.811 and a quadratic weighted kappa of 0.739 with the medical expert annotations in external validation. We conclude that the self-supervised contrastive learning method is an effective strategy for mRALE automated scoring. It provides a new approach to improve machine learning performance and minimize the expert knowledge involvement in quantitative medical image pattern learning.</p>","PeriodicalId":517398,"journal":{"name":"Medical image learning with limited and noisy data : second international workshop, MILLanD 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MILLanD (Workshop) : (2nd : 2023 : Vancouver, B...","volume":"14307 ","pages":"128-137"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10896252/pdf/","citationCount":"0","resultStr":"{\"title\":\"Automatic Quantification of COVID-19 Pulmonary Edema by Self-supervised Contrastive Learning.\",\"authors\":\"Zhaohui Liang, Zhiyun Xue, Sivaramakrishnan Rajaraman, Yang Feng, Sameer Antani\",\"doi\":\"10.1007/978-3-031-44917-8_12\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>We proposed a self-supervised machine learning method to automatically rate the severity of pulmonary edema in the frontal chest X-ray radiographs (CXR) which could be potentially related to COVID-19 viral pneumonia. For this we use the modified radiographic assessment of lung edema (mRALE) scoring system. The new model was first optimized with the simple Siamese network (SimSiam) architecture where a ResNet-50 pretrained by ImageNet database was used as the backbone. The encoder projected a 2048-dimension embedding as representation features to a downstream fully connected deep neural network for mRALE score prediction. A 5-fold cross-validation with 2,599 frontal CXRs was used to examine the new model's performance with comparison to a non-pretrained SimSiam encoder and a ResNet-50 trained from scratch. The mean absolute error (MAE) of the new model is 5.05 (95%CI 5.03-5.08), the mean squared error (MSE) is 66.67 (95%CI 66.29-67.06), and the Spearman's correlation coefficient (Spearman ρ) to the expert-annotated scores is 0.77 (95%CI 0.75-0.79). All the performance metrics of the new model are superior to the two comparators (P<0.01), and the scores of MSE and Spearman ρ of the two comparators have no statistical difference (P>0.05). The model also achieved a prediction probability concordance of 0.811 and a quadratic weighted kappa of 0.739 with the medical expert annotations in external validation. We conclude that the self-supervised contrastive learning method is an effective strategy for mRALE automated scoring. It provides a new approach to improve machine learning performance and minimize the expert knowledge involvement in quantitative medical image pattern learning.</p>\",\"PeriodicalId\":517398,\"journal\":{\"name\":\"Medical image learning with limited and noisy data : second international workshop, MILLanD 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MILLanD (Workshop) : (2nd : 2023 : Vancouver, B...\",\"volume\":\"14307 \",\"pages\":\"128-137\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10896252/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Medical image learning with limited and noisy data : second international workshop, MILLanD 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MILLanD (Workshop) : (2nd : 2023 : Vancouver, B...\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1007/978-3-031-44917-8_12\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/10/8 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical image learning with limited and noisy data : second international workshop, MILLanD 2023, held in conjunction with MICCAI 2023, Vancouver, BC, Canada, October 8, 2023, proceedings. MILLanD (Workshop) : (2nd : 2023 : Vancouver, B...","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/978-3-031-44917-8_12","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/10/8 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

我们提出了一种自我监督的机器学习方法,用于自动评定可能与 COVID-19 病毒性肺炎有关的正面胸部 X 光片(CXR)中肺水肿的严重程度。为此,我们使用了改良肺水肿放射学评估(mRALE)评分系统。新模型首先使用简单的连体网络(SimSiam)架构进行优化,以 ImageNet 数据库预训练的 ResNet-50 为骨干。编码器将 2048 维嵌入作为表示特征投射到下游的全连接深度神经网络,用于 mRALE 分数预测。使用 2,599 张正面 CXR 进行了 5 倍交叉验证,以检验新模型与未经预训练的 SimSiam 编码器和从头开始训练的 ResNet-50 相比的性能。新模型的平均绝对误差 (MAE) 为 5.05(95%CI 5.03-5.08),平均平方误差 (MSE) 为 66.67(95%CI 66.29-67.06),与专家注释分数的斯皮尔曼相关系数 (Spearman ρ) 为 0.77(95%CI 0.75-0.79)。新模型的所有性能指标均优于两个比较模型(P0.05)。在外部验证中,该模型与医学专家注释的预测概率一致性为 0.811,二次加权卡帕值为 0.739。我们的结论是,自监督对比学习法是 mRALE 自动评分的有效策略。它提供了一种新方法来提高机器学习性能,并最大限度地减少定量医学图像模式学习中专家知识的参与。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Automatic Quantification of COVID-19 Pulmonary Edema by Self-supervised Contrastive Learning.

We proposed a self-supervised machine learning method to automatically rate the severity of pulmonary edema in the frontal chest X-ray radiographs (CXR) which could be potentially related to COVID-19 viral pneumonia. For this we use the modified radiographic assessment of lung edema (mRALE) scoring system. The new model was first optimized with the simple Siamese network (SimSiam) architecture where a ResNet-50 pretrained by ImageNet database was used as the backbone. The encoder projected a 2048-dimension embedding as representation features to a downstream fully connected deep neural network for mRALE score prediction. A 5-fold cross-validation with 2,599 frontal CXRs was used to examine the new model's performance with comparison to a non-pretrained SimSiam encoder and a ResNet-50 trained from scratch. The mean absolute error (MAE) of the new model is 5.05 (95%CI 5.03-5.08), the mean squared error (MSE) is 66.67 (95%CI 66.29-67.06), and the Spearman's correlation coefficient (Spearman ρ) to the expert-annotated scores is 0.77 (95%CI 0.75-0.79). All the performance metrics of the new model are superior to the two comparators (P<0.01), and the scores of MSE and Spearman ρ of the two comparators have no statistical difference (P>0.05). The model also achieved a prediction probability concordance of 0.811 and a quadratic weighted kappa of 0.739 with the medical expert annotations in external validation. We conclude that the self-supervised contrastive learning method is an effective strategy for mRALE automated scoring. It provides a new approach to improve machine learning performance and minimize the expert knowledge involvement in quantitative medical image pattern learning.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信