AI as moral cover: How algorithmic bias exploits psychological mechanisms to perpetuate social inequality

IF 1.8 4区 社会学 Q3 PSYCHOLOGY, SOCIAL
Islam Borinca
{"title":"AI as moral cover: How algorithmic bias exploits psychological mechanisms to perpetuate social inequality","authors":"Islam Borinca","doi":"10.1111/asap.70031","DOIUrl":null,"url":null,"abstract":"<p>Algorithmic decision-making systems are increasingly shaping critical social outcomes (e.g., hiring, lending, criminal justice, healthcare), yet technical approaches to bias mitigation ignore crucial psychological mechanisms that enable discriminatory use. To address this gap, I integrate motivated reasoning, system justification, and moral disengagement theories to argue that AI systems may function as “moral cover,” allowing users to perpetuate inequality while maintaining beliefs in their own objectivity. Users often demonstrate “selective adherence,” following algorithmic advice when it confirms stereotypes while dismissing counter-stereotypical outputs. System justification motives lead people to defend discriminatory algorithmic outcomes as legitimate, “data-driven” decisions. Moral disengagement mechanisms (including responsibility displacement, euphemistic labeling, and advantageous comparison) can enable discrimination while preserving moral self-regard. Finally, I argue that understanding AI bias as fundamentally psychological rather than merely technical demands interventions addressing these underlying psychological processes alongside algorithmic improvements.</p>","PeriodicalId":46799,"journal":{"name":"Analyses of Social Issues and Public Policy","volume":"25 3","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2025-09-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://spssi.onlinelibrary.wiley.com/doi/epdf/10.1111/asap.70031","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Analyses of Social Issues and Public Policy","FirstCategoryId":"90","ListUrlMain":"https://spssi.onlinelibrary.wiley.com/doi/10.1111/asap.70031","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PSYCHOLOGY, SOCIAL","Score":null,"Total":0}
引用次数: 0

Abstract

Algorithmic decision-making systems are increasingly shaping critical social outcomes (e.g., hiring, lending, criminal justice, healthcare), yet technical approaches to bias mitigation ignore crucial psychological mechanisms that enable discriminatory use. To address this gap, I integrate motivated reasoning, system justification, and moral disengagement theories to argue that AI systems may function as “moral cover,” allowing users to perpetuate inequality while maintaining beliefs in their own objectivity. Users often demonstrate “selective adherence,” following algorithmic advice when it confirms stereotypes while dismissing counter-stereotypical outputs. System justification motives lead people to defend discriminatory algorithmic outcomes as legitimate, “data-driven” decisions. Moral disengagement mechanisms (including responsibility displacement, euphemistic labeling, and advantageous comparison) can enable discrimination while preserving moral self-regard. Finally, I argue that understanding AI bias as fundamentally psychological rather than merely technical demands interventions addressing these underlying psychological processes alongside algorithmic improvements.

Abstract Image

Abstract Image

Abstract Image

人工智能作为道德掩护:算法偏见如何利用心理机制使社会不平等永久化
算法决策系统正日益影响关键的社会结果(例如,招聘、贷款、刑事司法、医疗保健),但减少偏见的技术方法忽视了导致歧视性使用的关键心理机制。为了解决这一差距,我整合了动机推理、系统辩护和道德脱离理论,认为人工智能系统可能起到“道德掩护”的作用,允许用户在保持对自己客观性的信念的同时延续不平等。用户经常表现出“选择性遵守”,当算法的建议证实了刻板印象,而忽略了反刻板印象的输出时,他们会遵循算法的建议。系统辩护动机导致人们将歧视性算法结果辩护为合法的、“数据驱动的”决定。道德脱离机制(包括责任转移、委婉标签和优势比较)可以在保持道德自我关注的同时使歧视成为可能。最后,我认为,理解人工智能偏见从根本上是心理上的,而不仅仅是技术上的,需要在改进算法的同时干预这些潜在的心理过程。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.80
自引率
6.70%
发文量
42
期刊介绍: Recent articles in ASAP have examined social psychological methods in the study of economic and social justice including ageism, heterosexism, racism, sexism, status quo bias and other forms of discrimination, social problems such as climate change, extremism, homelessness, inter-group conflict, natural disasters, poverty, and terrorism, and social ideals such as democracy, empowerment, equality, health, and trust.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信