Christopher Nielsen, Matthias Wilms, Nils D Forkert
{"title":"基于同态加密的高效糖尿病视网膜病变分类联合学习。","authors":"Christopher Nielsen, Matthias Wilms, Nils D Forkert","doi":"10.1117/1.JMI.12.3.034504","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Diabetic retinopathy (DR) is the leading cause of blindness among working-age adults globally. Although machine learning (ML) has shown promise for DR diagnosis, ensuring model generalizability requires training on data from diverse populations. Federated learning (FL) offers a potential solution by enabling model training on decentralized datasets. However, privacy concerns persist in FL due to potential privacy breaches, such as gradient inversion attacks, which can be used to reconstruct sensitive training data and may discourage participation from patients.</p><p><strong>Approach: </strong>We developed and tested a computationally efficient FL framework that integrates homomorphic encryption (HE) to safeguard patient privacy using 6457 retinal fundus images from the APTOS-2019 and ODIR-5K datasets. First, features are extracted from distributed fundus images using RETFound, a large pretrained foundation model for retinal analysis. These encrypted features are then used to train a lightweight multiclass logistic regression head (MLRH) model for DR grade classification using FL.</p><p><strong>Results: </strong>Experimental results show that the MLRH model trained using FL achieves similar performance compared with a fully fine-tuned RETFound model on centralized data, with the area under the receiver operating characteristic curve scores of <math><mrow><mn>0.93</mn> <mo>±</mo> <mn>0.01</mn></mrow> </math> on APTOS-2019 and <math><mrow><mn>0.78</mn> <mo>±</mo> <mn>0.02</mn></mrow> </math> on ODIR-5K. Efficiency improvements include a 95.9-fold reduction in computation time and a 63.0-fold reduction in data transfer needs compared with fine-tuning the full RETFound model with FL. In addition, results showed that integrating HE effectively protects patient data against gradient inversion attacks.</p><p><strong>Conclusions: </strong>We advance privacy-preserving, ML-based DR screening technology, supporting the goal of equitable vision care worldwide.</p>","PeriodicalId":47707,"journal":{"name":"Journal of Medical Imaging","volume":"12 3","pages":"034504"},"PeriodicalIF":1.7000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12128631/pdf/","citationCount":"0","resultStr":"{\"title\":\"Highly efficient homomorphic encryption-based federated learning for diabetic retinopathy classification.\",\"authors\":\"Christopher Nielsen, Matthias Wilms, Nils D Forkert\",\"doi\":\"10.1117/1.JMI.12.3.034504\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>Diabetic retinopathy (DR) is the leading cause of blindness among working-age adults globally. Although machine learning (ML) has shown promise for DR diagnosis, ensuring model generalizability requires training on data from diverse populations. Federated learning (FL) offers a potential solution by enabling model training on decentralized datasets. However, privacy concerns persist in FL due to potential privacy breaches, such as gradient inversion attacks, which can be used to reconstruct sensitive training data and may discourage participation from patients.</p><p><strong>Approach: </strong>We developed and tested a computationally efficient FL framework that integrates homomorphic encryption (HE) to safeguard patient privacy using 6457 retinal fundus images from the APTOS-2019 and ODIR-5K datasets. First, features are extracted from distributed fundus images using RETFound, a large pretrained foundation model for retinal analysis. These encrypted features are then used to train a lightweight multiclass logistic regression head (MLRH) model for DR grade classification using FL.</p><p><strong>Results: </strong>Experimental results show that the MLRH model trained using FL achieves similar performance compared with a fully fine-tuned RETFound model on centralized data, with the area under the receiver operating characteristic curve scores of <math><mrow><mn>0.93</mn> <mo>±</mo> <mn>0.01</mn></mrow> </math> on APTOS-2019 and <math><mrow><mn>0.78</mn> <mo>±</mo> <mn>0.02</mn></mrow> </math> on ODIR-5K. Efficiency improvements include a 95.9-fold reduction in computation time and a 63.0-fold reduction in data transfer needs compared with fine-tuning the full RETFound model with FL. In addition, results showed that integrating HE effectively protects patient data against gradient inversion attacks.</p><p><strong>Conclusions: </strong>We advance privacy-preserving, ML-based DR screening technology, supporting the goal of equitable vision care worldwide.</p>\",\"PeriodicalId\":47707,\"journal\":{\"name\":\"Journal of Medical Imaging\",\"volume\":\"12 3\",\"pages\":\"034504\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12128631/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Medical Imaging\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1117/1.JMI.12.3.034504\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/6/2 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q3\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Medical Imaging","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1117/1.JMI.12.3.034504","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/6/2 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
Highly efficient homomorphic encryption-based federated learning for diabetic retinopathy classification.
Purpose: Diabetic retinopathy (DR) is the leading cause of blindness among working-age adults globally. Although machine learning (ML) has shown promise for DR diagnosis, ensuring model generalizability requires training on data from diverse populations. Federated learning (FL) offers a potential solution by enabling model training on decentralized datasets. However, privacy concerns persist in FL due to potential privacy breaches, such as gradient inversion attacks, which can be used to reconstruct sensitive training data and may discourage participation from patients.
Approach: We developed and tested a computationally efficient FL framework that integrates homomorphic encryption (HE) to safeguard patient privacy using 6457 retinal fundus images from the APTOS-2019 and ODIR-5K datasets. First, features are extracted from distributed fundus images using RETFound, a large pretrained foundation model for retinal analysis. These encrypted features are then used to train a lightweight multiclass logistic regression head (MLRH) model for DR grade classification using FL.
Results: Experimental results show that the MLRH model trained using FL achieves similar performance compared with a fully fine-tuned RETFound model on centralized data, with the area under the receiver operating characteristic curve scores of on APTOS-2019 and on ODIR-5K. Efficiency improvements include a 95.9-fold reduction in computation time and a 63.0-fold reduction in data transfer needs compared with fine-tuning the full RETFound model with FL. In addition, results showed that integrating HE effectively protects patient data against gradient inversion attacks.
Conclusions: We advance privacy-preserving, ML-based DR screening technology, supporting the goal of equitable vision care worldwide.
期刊介绍:
JMI covers fundamental and translational research, as well as applications, focused on medical imaging, which continue to yield physical and biomedical advancements in the early detection, diagnostics, and therapy of disease as well as in the understanding of normal. The scope of JMI includes: Imaging physics, Tomographic reconstruction algorithms (such as those in CT and MRI), Image processing and deep learning, Computer-aided diagnosis and quantitative image analysis, Visualization and modeling, Picture archiving and communications systems (PACS), Image perception and observer performance, Technology assessment, Ultrasonic imaging, Image-guided procedures, Digital pathology, Biomedical applications of biomedical imaging. JMI allows for the peer-reviewed communication and archiving of scientific developments, translational and clinical applications, reviews, and recommendations for the field.