Intelligent Systems, Vulnerable Minds: A Framework for Radicalization to Violence in the Age of AI.

IF 14.6 1区 心理学 Q1 PSYCHOLOGY, SOCIAL
Jonas R Kunst,Milan Obaidi,Anton Gollwitzer,Petter B Brandtzæg,Yannic Hinrichs,Neha Saini,Daniel T Schroeder
{"title":"Intelligent Systems, Vulnerable Minds: A Framework for Radicalization to Violence in the Age of AI.","authors":"Jonas R Kunst,Milan Obaidi,Anton Gollwitzer,Petter B Brandtzæg,Yannic Hinrichs,Neha Saini,Daniel T Schroeder","doi":"10.1177/10888683261430089","DOIUrl":null,"url":null,"abstract":"Academic AbstractAdvances in AI require a revision of the psychological and socio-technical dynamics by which individuals are radicalized to embrace violent extremism. This review synthesizes process models of radicalization with research on social and personality risk factors, AI, and psychological mechanisms to propose a four-stage framework mapping the AI architecture of radicalization: (1) Exposure, where recommender systems and virality features create initial attraction to extreme content; (2) Reinforcement, where filter bubbles and group recommendations leverage biases to strengthen extremist beliefs and create echo chambers; (3) Group Integration, where ideologically homogenous clusters, AI bot swarms and companions foster group belonging and readiness for action; cumulatively resulting in (4) Violent Extremist Action. We examine how established social, cognitive, personality, and contextual vulnerability factors heighten psychological risk in the AI-driven radicalization process, as well as the emerging role of generative AI. We conclude by outlining a stage-based framework for governance and future research.Public AbstractAI-driven algorithms designed to maximize engagement on social media, compounded by generative AI, can unintentionally set the stage for radicalization. It begins with Exposure, where algorithms push users toward extreme content because it captures attention. Next, during Reinforcement, algorithms feed users personalized content while AI swarms can create a synthetic consensus that reinforces emerging biases, normalizes extremity, and insulates users from alternative views. Third, during Group Integration, individuals are absorbed into extremist networks, reinforced by human peers, AI companions, and bot swarms that validate radical beliefs and deepen identity ties. By exploiting psychological needs for belonging and certainty, this stage becomes particularly pernicious, potentially opening the door for violence. We propose policy measures that can reduce radicalization at each stage.","PeriodicalId":48386,"journal":{"name":"Personality and Social Psychology Review","volume":"19 1","pages":"10888683261430089"},"PeriodicalIF":14.6000,"publicationDate":"2026-03-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Personality and Social Psychology Review","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/10888683261430089","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, SOCIAL","Score":null,"Total":0}
引用次数: 0

Abstract

Academic AbstractAdvances in AI require a revision of the psychological and socio-technical dynamics by which individuals are radicalized to embrace violent extremism. This review synthesizes process models of radicalization with research on social and personality risk factors, AI, and psychological mechanisms to propose a four-stage framework mapping the AI architecture of radicalization: (1) Exposure, where recommender systems and virality features create initial attraction to extreme content; (2) Reinforcement, where filter bubbles and group recommendations leverage biases to strengthen extremist beliefs and create echo chambers; (3) Group Integration, where ideologically homogenous clusters, AI bot swarms and companions foster group belonging and readiness for action; cumulatively resulting in (4) Violent Extremist Action. We examine how established social, cognitive, personality, and contextual vulnerability factors heighten psychological risk in the AI-driven radicalization process, as well as the emerging role of generative AI. We conclude by outlining a stage-based framework for governance and future research.Public AbstractAI-driven algorithms designed to maximize engagement on social media, compounded by generative AI, can unintentionally set the stage for radicalization. It begins with Exposure, where algorithms push users toward extreme content because it captures attention. Next, during Reinforcement, algorithms feed users personalized content while AI swarms can create a synthetic consensus that reinforces emerging biases, normalizes extremity, and insulates users from alternative views. Third, during Group Integration, individuals are absorbed into extremist networks, reinforced by human peers, AI companions, and bot swarms that validate radical beliefs and deepen identity ties. By exploiting psychological needs for belonging and certainty, this stage becomes particularly pernicious, potentially opening the door for violence. We propose policy measures that can reduce radicalization at each stage.
智能系统,脆弱的心灵:在人工智能时代激进暴力的框架。
学术摘要人工智能的进步需要对心理和社会技术动态进行修订,这些动态使个人激进地接受暴力极端主义。本文将激进化的过程模型与社会和人格风险因素、人工智能和心理机制的研究相结合,提出了一个描绘激进化人工智能架构的四阶段框架:(1)曝光,其中推荐系统和病毒式传播特征对极端内容产生最初的吸引力;(2)强化,即过滤气泡和团体建议利用偏见来强化极端主义信仰并创造回音室;(3)群体整合,即意识形态同质的集群、人工智能机器人群和同伴促进群体归属感和行动准备;(4)暴力极端主义行为。我们研究了社会、认知、人格和环境脆弱性因素如何在人工智能驱动的激进化过程中增加心理风险,以及生成式人工智能的新兴作用。最后,我们概述了用于治理和未来研究的基于阶段的框架。旨在最大限度地提高社交媒体参与度的人工智能驱动算法,加上生成式人工智能,可能无意中为激进化奠定了基础。它从曝光开始,算法将用户推向极端内容,因为它能吸引注意力。接下来,在强化过程中,算法为用户提供个性化的内容,而人工智能群体可以创造一种综合共识,强化新出现的偏见,使极端行为正常化,并使用户与其他观点隔离。第三,在群体整合过程中,个人被吸收到极端主义网络中,并被人类同伴、人工智能同伴和机器人群强化,从而证实激进信仰并加深身份联系。通过利用对归属感和确定性的心理需求,这一阶段变得特别有害,可能为暴力打开大门。我们提出了可以在每个阶段减少激进化的政策措施。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
19.00
自引率
1.90%
发文量
20
期刊介绍: Title: Personality and Social Psychology Review (PSPR) Journal Overview: Official journal of SPSP, the Society for Personality and Social Psychology, Inc. Premiere outlet for original theoretical papers and conceptual review articles in all areas of personality and social psychology Features stimulating conceptual pieces identifying new research directions and comprehensive review papers providing integrative frameworks for existing theory and research programs Topics Covered: Attitudes and Social Cognition: Examines the inner workings of the human mind in understanding, evaluating, and responding to the social environment Interpersonal and Group Processes: Explores patterns of interaction and interdependence characterizing everyday human functioning Intergroup Relations: Investigates determinants of prejudice, conflict, cooperation, and harmonious relationships between social groups Personality and Individual Differences: Focuses on causes, assessment, structures, and processes giving rise to human variation Biological and Cultural Influences: Studies the biological and cultural mediation of social psychological and personality processes
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书