Challenges in medical algorithmic fairness.

IF 4.8 Q2 ONCOLOGY
Anand Srinivasan, Durga V Sritharan, Sanjay Aneja, Ilana B Richman
{"title":"Challenges in medical algorithmic fairness.","authors":"Anand Srinivasan, Durga V Sritharan, Sanjay Aneja, Ilana B Richman","doi":"10.1093/jncics/pkag081","DOIUrl":null,"url":null,"abstract":"<p><p>Artificial intelligence (AI) is increasingly being integrated into oncology for applications including cancer detection, risk stratification, treatment planning, and clinical documentation. Concerningly, growing evidence demonstrates that AI systems can reproduce or amplify existing disparities across patient populations. Although considerable effort has focused on developing computational methods to reduce algorithmic bias, many challenges surrounding fairness extend beyond technical implementation. In this commentary, we examine algorithmic fairness in oncology from technical and normative perspectives. We review common sources of bias throughout the machine-learning pipeline; discuss major statistical definitions of fairness, including demographic parity, calibration, and equalized odds; and highlight the inherent trade-offs among these metrics. We further explore how fairness often conflicts with overall predictive performance, arguing that model selection inevitably reflects ethical judgments rather than purely technical optimization. We discuss the limitations of current bias mitigation strategies and contend that many disparities rooted in historical and structural inequities cannot be resolved through algorithmic interventions alone. Finally, we outline priorities for the responsible development and deployment of clinical AI, including greater transparency in fairness decisions, context-specific evaluation standards, ongoing postdeployment auditing, and stronger regulatory oversight. Achieving equitable AI in oncology will require coordinated efforts among developers, clinicians, regulators, and patients to ensure that these technologies improve outcomes without perpetuating existing inequities.</p>","PeriodicalId":14681,"journal":{"name":"JNCI Cancer Spectrum","volume":" ","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2026-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13557619/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JNCI Cancer Spectrum","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/jncics/pkag081","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ONCOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Artificial intelligence (AI) is increasingly being integrated into oncology for applications including cancer detection, risk stratification, treatment planning, and clinical documentation. Concerningly, growing evidence demonstrates that AI systems can reproduce or amplify existing disparities across patient populations. Although considerable effort has focused on developing computational methods to reduce algorithmic bias, many challenges surrounding fairness extend beyond technical implementation. In this commentary, we examine algorithmic fairness in oncology from technical and normative perspectives. We review common sources of bias throughout the machine-learning pipeline; discuss major statistical definitions of fairness, including demographic parity, calibration, and equalized odds; and highlight the inherent trade-offs among these metrics. We further explore how fairness often conflicts with overall predictive performance, arguing that model selection inevitably reflects ethical judgments rather than purely technical optimization. We discuss the limitations of current bias mitigation strategies and contend that many disparities rooted in historical and structural inequities cannot be resolved through algorithmic interventions alone. Finally, we outline priorities for the responsible development and deployment of clinical AI, including greater transparency in fairness decisions, context-specific evaluation standards, ongoing postdeployment auditing, and stronger regulatory oversight. Achieving equitable AI in oncology will require coordinated efforts among developers, clinicians, regulators, and patients to ensure that these technologies improve outcomes without perpetuating existing inequities.

医疗算法公平性的挑战。
人工智能(AI)越来越多地应用于肿瘤学,包括癌症检测、风险分层、治疗计划和临床记录。令人担忧的是,越来越多的证据表明,人工智能系统可以再现或扩大患者群体之间现有的差距。尽管相当大的努力集中在开发计算方法来减少算法偏差,但围绕公平性的许多挑战超出了技术实现。在这篇评论中,我们从技术和规范的角度来研究肿瘤学中的算法公平性。我们回顾了整个机器学习管道中常见的偏见来源,讨论了公平的主要统计定义,包括人口平价、校准和均等赔率,并强调了这些指标之间的内在权衡。我们进一步探讨了公平性如何经常与整体预测性能相冲突,认为模型选择不可避免地反映了道德判断,而不是纯粹的技术优化。我们讨论了当前偏见缓解策略的局限性,并认为许多根植于历史和结构不平等的差异不能仅通过算法干预来解决。最后,我们概述了负责任的临床人工智能开发和部署的优先事项,包括提高公平性决策的透明度、具体情况的评估标准、持续的部署后审计和更强有力的监管监督。在肿瘤学领域实现公平的人工智能将需要开发人员、临床医生、监管机构和患者之间的协调努力,以确保这些技术在不延续现有不公平的情况下改善结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
JNCI Cancer Spectrum
JNCI Cancer Spectrum Medicine-Oncology
CiteScore
7.70
自引率
0.00%
发文量
80
审稿时长
18 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书