Algorithmic bias in surgical risk prediction models and its impact on patient safety: a review.

IF 3.3 Q1 SURGERY
Mohamed Mustaf Ahmed
{"title":"Algorithmic bias in surgical risk prediction models and its impact on patient safety: a review.","authors":"Mohamed Mustaf Ahmed","doi":"10.1186/s13037-026-00495-x","DOIUrl":null,"url":null,"abstract":"<p><p>The increasing adoption of machine learning and artificial intelligence in surgical risk prediction has introduced new challenges related to the fairness and equity of these algorithms. These models range from regression-based risk calculators to machine learning systems, and differential performance may reflect poor calibration within a group, which is mainly a safety concern, or unequal performance between groups, which is mainly an equity concern. Predictive models trained on surgical registry data have shown differential performance across racial and ethnic groups in some studies, raising concerns about the potential for these tools to perpetuate or amplify existing disparities in surgical care. This review examines the sources and mechanisms of algorithmic bias in surgical risk prediction models, evaluates the evidence for differential model performance across patient subgroups, and discusses emerging debiasing strategies and regulatory frameworks. Training datasets from major surgical registries frequently contain incomplete or poorly granular race and ethnicity data, and the inclusion of race as a predictive variable remains controversial. Individual studies have reported lower sensitivity or higher false-negative rates for specific subgroups, potentially leading to an underestimation of surgical risk in those groups, although such discrimination-based measures do not by themselves establish miscalibration or demonstrated harm. Debiasing techniques, including reweighting, adversarial training, and fairness-aware multitask learning, have shown promise but remain largely untested in surgical contexts and are constrained by inherent trade-offs between within-group calibration and error rate parity across groups. Although regulatory bodies have begun to address algorithmic fairness, standardized auditing frameworks for surgical prediction models are still lacking. This review highlights the need for multicenter, demographically diverse validation studies, transparent model reporting, and equity-focused governance to ensure that artificial intelligence in surgery serves all patients safely and equitably.</p>","PeriodicalId":46782,"journal":{"name":"Patient Safety in Surgery","volume":" ","pages":""},"PeriodicalIF":3.3000,"publicationDate":"2026-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13548563/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Patient Safety in Surgery","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s13037-026-00495-x","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0

Abstract

The increasing adoption of machine learning and artificial intelligence in surgical risk prediction has introduced new challenges related to the fairness and equity of these algorithms. These models range from regression-based risk calculators to machine learning systems, and differential performance may reflect poor calibration within a group, which is mainly a safety concern, or unequal performance between groups, which is mainly an equity concern. Predictive models trained on surgical registry data have shown differential performance across racial and ethnic groups in some studies, raising concerns about the potential for these tools to perpetuate or amplify existing disparities in surgical care. This review examines the sources and mechanisms of algorithmic bias in surgical risk prediction models, evaluates the evidence for differential model performance across patient subgroups, and discusses emerging debiasing strategies and regulatory frameworks. Training datasets from major surgical registries frequently contain incomplete or poorly granular race and ethnicity data, and the inclusion of race as a predictive variable remains controversial. Individual studies have reported lower sensitivity or higher false-negative rates for specific subgroups, potentially leading to an underestimation of surgical risk in those groups, although such discrimination-based measures do not by themselves establish miscalibration or demonstrated harm. Debiasing techniques, including reweighting, adversarial training, and fairness-aware multitask learning, have shown promise but remain largely untested in surgical contexts and are constrained by inherent trade-offs between within-group calibration and error rate parity across groups. Although regulatory bodies have begun to address algorithmic fairness, standardized auditing frameworks for surgical prediction models are still lacking. This review highlights the need for multicenter, demographically diverse validation studies, transparent model reporting, and equity-focused governance to ensure that artificial intelligence in surgery serves all patients safely and equitably.

手术风险预测模型中的算法偏差及其对患者安全的影响:综述
机器学习和人工智能在手术风险预测中的应用越来越多,这给这些算法的公平性和公平性带来了新的挑战。这些模型的范围从基于回归的风险计算器到机器学习系统,不同的表现可能反映了组内校准不良,这主要是安全问题,或者组间表现不平等,这主要是公平问题。根据手术登记数据训练的预测模型在一些研究中显示出不同种族和民族的表现差异,这引起了人们对这些工具可能延续或扩大手术护理中现有差异的担忧。这篇综述探讨了手术风险预测模型中算法偏差的来源和机制,评估了不同患者亚组模型表现差异的证据,并讨论了新兴的消除偏差策略和监管框架。来自主要外科注册中心的训练数据集经常包含不完整或粒度差的种族和民族数据,并且将种族作为预测变量仍然存在争议。个别研究报告了对特定亚组较低的敏感性或较高的假阴性率,这可能导致对这些亚组手术风险的低估,尽管这种基于歧视的测量本身并不能建立错误校准或证明有害。包括重加权、对抗性训练和公平感知多任务学习在内的去偏技术已经显示出前景,但在外科手术环境中仍未得到很大程度的测试,并且受到组内校准和组间错误率均等之间固有权衡的限制。尽管监管机构已经开始解决算法公平性问题,但手术预测模型的标准化审计框架仍然缺乏。本综述强调需要进行多中心、人口统计学多样化的验证研究、透明的模型报告和以公平为重点的治理,以确保手术中的人工智能安全、公平地为所有患者服务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.80
自引率
8.10%
发文量
37
审稿时长
9 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书