{"title":"ActivFairNet: A novel framework for mitigating bias in deep learning networks using activation map-based fairness regularization","authors":"Asmaa AbdulQawy , Elsayed Sallam , Amr Elkholy","doi":"10.1016/j.eij.2025.100739","DOIUrl":null,"url":null,"abstract":"<div><div>The rapid advancements in Artificial Intelligence underscore the pressing need to address fairness in deep learning, particularly in critical fields like healthcare where decisions have direct and significant impacts on lives. Despite considerable progress, biases associated with sensitive attributes such as gender, race, and age remain pervasive, presenting substantial challenges to achieving equitable and reliable outcomes. This paper introduces ActivFairNet, a novel bias mitigation framework that integrates activation maps as a fairness regularizer. The framework ensures unbiased representation learning across demographic groups while maintaining or enhancing predictive accuracy, making it both effective and practical for real-world applications. The ActivFairNet is evaluated in a COVID-19 detection case study using a chest X-ray dataset collected from five public repositories. Its effectiveness was tested on three models with varying gender distributions, employing two widely recognized deep learning architectures, DenseNet121 and Xception. The results demonstrate that the ActivFairNet Regularizer consistently outperforms three established bias mitigation techniques, significantly reducing bias across key fairness metrics. Specifically, the method achieves substantial improvements, including a Statistical Parity Difference (SPD) of 0.003 (down from 0.162), an Equal Opportunity Difference (EOD) of 0.000 (down from 0.276), and an Average Odds Difference (AOD) of 0.002 (down from 0.185). The ActivFairNet Regularizer offers a practical, scalable, and ethically aligned solution for mitigating demographic bias in medical imaging, contributing to the advancement of fair and reliable AI systems in real-world healthcare environments.</div></div>","PeriodicalId":56010,"journal":{"name":"Egyptian Informatics Journal","volume":"31 ","pages":"Article 100739"},"PeriodicalIF":4.3000,"publicationDate":"2025-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Egyptian Informatics Journal","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S111086652500132X","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
The rapid advancements in Artificial Intelligence underscore the pressing need to address fairness in deep learning, particularly in critical fields like healthcare where decisions have direct and significant impacts on lives. Despite considerable progress, biases associated with sensitive attributes such as gender, race, and age remain pervasive, presenting substantial challenges to achieving equitable and reliable outcomes. This paper introduces ActivFairNet, a novel bias mitigation framework that integrates activation maps as a fairness regularizer. The framework ensures unbiased representation learning across demographic groups while maintaining or enhancing predictive accuracy, making it both effective and practical for real-world applications. The ActivFairNet is evaluated in a COVID-19 detection case study using a chest X-ray dataset collected from five public repositories. Its effectiveness was tested on three models with varying gender distributions, employing two widely recognized deep learning architectures, DenseNet121 and Xception. The results demonstrate that the ActivFairNet Regularizer consistently outperforms three established bias mitigation techniques, significantly reducing bias across key fairness metrics. Specifically, the method achieves substantial improvements, including a Statistical Parity Difference (SPD) of 0.003 (down from 0.162), an Equal Opportunity Difference (EOD) of 0.000 (down from 0.276), and an Average Odds Difference (AOD) of 0.002 (down from 0.185). The ActivFairNet Regularizer offers a practical, scalable, and ethically aligned solution for mitigating demographic bias in medical imaging, contributing to the advancement of fair and reliable AI systems in real-world healthcare environments.
期刊介绍:
The Egyptian Informatics Journal is published by the Faculty of Computers and Artificial Intelligence, Cairo University. This Journal provides a forum for the state-of-the-art research and development in the fields of computing, including computer sciences, information technologies, information systems, operations research and decision support. Innovative and not-previously-published work in subjects covered by the Journal is encouraged to be submitted, whether from academic, research or commercial sources.