Zhen Ling Teo MBBS, FRCOphth , Xiaoman Zhang MS , Yechao Yang BS , Liyuan Jin MBBS , Chi Zhang PhD , Stanley Shuoh Jieh Poh MBBS, FRCOphth , Weihong Yu MD, PhD , Youxin Chen MD , Jost B. Jonas MD, PhD , Ya Xing Wang MD , Wei-Chi Wu MD, PhD , Chi-Chun Lai MD , Yong Liu PhD , Rick Siow Mong Goh PhD , Daniel Shu Wei Ting MD, PhD
{"title":"Privacy-Preserving Technology Using Federated Learning and Blockchain in Protecting against Adversarial Attacks for Retinal Imaging","authors":"Zhen Ling Teo MBBS, FRCOphth , Xiaoman Zhang MS , Yechao Yang BS , Liyuan Jin MBBS , Chi Zhang PhD , Stanley Shuoh Jieh Poh MBBS, FRCOphth , Weihong Yu MD, PhD , Youxin Chen MD , Jost B. Jonas MD, PhD , Ya Xing Wang MD , Wei-Chi Wu MD, PhD , Chi-Chun Lai MD , Yong Liu PhD , Rick Siow Mong Goh PhD , Daniel Shu Wei Ting MD, PhD","doi":"10.1016/j.ophtha.2024.10.017","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>Collaboration provides valuable data for robust artificial intelligence (AI) model development. Federated learning (FL) is a privacy-enhancing technology that allows collaboration while respecting privacy via the development of models without raw data transfer. However state-of-the-art FL models still face challenges in non-independent and identically distributed (non-IID) health care settings and remain susceptible to privacy breaches. We propose an FL framework coupled with blockchain technology to address these challenges.</div></div><div><h3>Design</h3><div>Retrospective, multicohort study.</div></div><div><h3>Main Outcome Measures</h3><div>We evaluated our FL model performance in myopic macular degeneration (MMD) and OCT classification and compared our model against state-of the-art FL and centralized models.</div></div><div><h3>Methods</h3><div>A total of 27 145 images from Singapore, China, and Taiwan were used to design a novel FL aggregation method for the detection of MMD from fundus photographs and macular disease from OCT scans in feature distribution skew and label distribution imbalance scenarios. We further performed adversarial attacks (label flipping and clean label). As proof of concept, blockchain was incorporated into FL to demonstrate secure transfer of model updates across collaborating sites.</div></div><div><h3>Results</h3><div>Our FL model showed robust performance with an area under the curve (AUC) of 0.868 ± 0.009 for MMD detection and 0.970 ± 0.012 for OCT macular disease classification. In label flipping attack, our FL model had an AUC of 0.861 ± 0.019, similar to the centralized model (AUC 0.856 ± 0.015) and higher than other FL models (AUC 0.578–0.819). In clean label attack, our FL model had an AUC of 0.878 ± 0.006, which was comparable to the centralized model (AUC 0.878 ± 0.001) and superior to other state-of-the-art FL models with an AUC of 0.529 to 0.838. Simulation showed that the additional time with blockchain in 1 global epoch was approximately 5 seconds. The addition of blockchain to the FL framework was feasible with a minimal impact on model development time.</div></div><div><h3>Conclusions</h3><div>Our proposed FL algorithm overcomes the shortcoming of the traditional FL in non-IID situations and remains robust against adversarial attacks. The integration of blockchain adds further security during the transfer of model updates. Blockchain-enabled FL can be a trusted platform for collaborative health AI research.</div></div><div><h3>Financial Disclosure(s)</h3><div>The author(s) have no proprietary or commercial interest in any materials discussed in this article.</div></div>","PeriodicalId":19533,"journal":{"name":"Ophthalmology","volume":"132 4","pages":"Pages 484-494"},"PeriodicalIF":13.1000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ophthalmology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016164202400633X","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
Collaboration provides valuable data for robust artificial intelligence (AI) model development. Federated learning (FL) is a privacy-enhancing technology that allows collaboration while respecting privacy via the development of models without raw data transfer. However state-of-the-art FL models still face challenges in non-independent and identically distributed (non-IID) health care settings and remain susceptible to privacy breaches. We propose an FL framework coupled with blockchain technology to address these challenges.
Design
Retrospective, multicohort study.
Main Outcome Measures
We evaluated our FL model performance in myopic macular degeneration (MMD) and OCT classification and compared our model against state-of the-art FL and centralized models.
Methods
A total of 27 145 images from Singapore, China, and Taiwan were used to design a novel FL aggregation method for the detection of MMD from fundus photographs and macular disease from OCT scans in feature distribution skew and label distribution imbalance scenarios. We further performed adversarial attacks (label flipping and clean label). As proof of concept, blockchain was incorporated into FL to demonstrate secure transfer of model updates across collaborating sites.
Results
Our FL model showed robust performance with an area under the curve (AUC) of 0.868 ± 0.009 for MMD detection and 0.970 ± 0.012 for OCT macular disease classification. In label flipping attack, our FL model had an AUC of 0.861 ± 0.019, similar to the centralized model (AUC 0.856 ± 0.015) and higher than other FL models (AUC 0.578–0.819). In clean label attack, our FL model had an AUC of 0.878 ± 0.006, which was comparable to the centralized model (AUC 0.878 ± 0.001) and superior to other state-of-the-art FL models with an AUC of 0.529 to 0.838. Simulation showed that the additional time with blockchain in 1 global epoch was approximately 5 seconds. The addition of blockchain to the FL framework was feasible with a minimal impact on model development time.
Conclusions
Our proposed FL algorithm overcomes the shortcoming of the traditional FL in non-IID situations and remains robust against adversarial attacks. The integration of blockchain adds further security during the transfer of model updates. Blockchain-enabled FL can be a trusted platform for collaborative health AI research.
Financial Disclosure(s)
The author(s) have no proprietary or commercial interest in any materials discussed in this article.
期刊介绍:
The journal Ophthalmology, from the American Academy of Ophthalmology, contributes to society by publishing research in clinical and basic science related to vision.It upholds excellence through unbiased peer-review, fostering innovation, promoting discovery, and encouraging lifelong learning.