Beyond rules: A focused comparative vignette analysis of how public AI systems interpret sexual coercion, privacy abuse, and grooming in adolescent digital scenarios

Tsameret Ricon
{"title":"Beyond rules: A focused comparative vignette analysis of how public AI systems interpret sexual coercion, privacy abuse, and grooming in adolescent digital scenarios","authors":"Tsameret Ricon","doi":"10.1016/j.chbah.2026.100320","DOIUrl":null,"url":null,"abstract":"<div><div>Adolescents increasingly turn to conversational artificial intelligence systems for information, interpretation, and advice about intimate relationships, sexuality, privacy, and online conflict. Yet current AI safety evaluations often focus on explicit content violations and harmful outputs, while paying less attention to morally ambiguous forms of relational harm, such as coercive sexting, sextortion, and online grooming. These harms are especially difficult to identify because they often appear through ordinary relationship language, including loyalty tests, emotional pressure, secrecy, flattery, and threats framed as intimacy.</div><div>This study examines how four publicly accessible conversational AI systems interpret adolescent digital harm scenarios that vary in explicitness and relational ambiguity. Drawing on Communication Privacy Management theory, relational ethics, and research on adolescent digital vulnerability, the study developed a twelve-vignette matrix crossing three scenario families: pressure to send intimate images, threats to distribute previously shared images, and grooming-related secrecy and exclusivity. The present article reports a focused qualitative comparative analysis of three theoretically selected vignettes drawn from this matrix: subtle relational pressure to send an intimate image, explicit sextortion, and grooming through flattery and exclusivity. Model responses were analyzed using a descriptive coding rubric covering harm recognition, conceptual precision, moral clarity, responsibility attribution, developmental sensitivity, guidance quality, and actionability.</div><div>The findings from the three focal vignettes show strong convergence across models in scenarios involving explicit image-based sexual extortion and clear adult minor power asymmetries. In these cases, all systems recognized harm, attributed responsibility to the perpetrator, and avoided victim blaming. Greater variation emerged in more ambiguous scenarios involving emotional pressure, normative minimization, and subtle relational coercion. Although models often recognized manipulation, they differed in their use of precise harm terminology and in the specificity of their protective guidance.</div><div>The study contributes a relational and developmentally informed framework for evaluating AI responses to adolescent digital harm. It shows that the central challenge for youth facing AI systems may not be whether models can detect obvious abuse, but whether they can name, explain, and respond to coercion when harm is embedded in ordinary relationship language.</div></div>","PeriodicalId":100324,"journal":{"name":"Computers in Human Behavior: Artificial Humans","volume":"8 ","pages":"Article 100320"},"PeriodicalIF":0.0000,"publicationDate":"2026-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers in Human Behavior: Artificial Humans","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2949882126000721","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/5/23 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Adolescents increasingly turn to conversational artificial intelligence systems for information, interpretation, and advice about intimate relationships, sexuality, privacy, and online conflict. Yet current AI safety evaluations often focus on explicit content violations and harmful outputs, while paying less attention to morally ambiguous forms of relational harm, such as coercive sexting, sextortion, and online grooming. These harms are especially difficult to identify because they often appear through ordinary relationship language, including loyalty tests, emotional pressure, secrecy, flattery, and threats framed as intimacy.
This study examines how four publicly accessible conversational AI systems interpret adolescent digital harm scenarios that vary in explicitness and relational ambiguity. Drawing on Communication Privacy Management theory, relational ethics, and research on adolescent digital vulnerability, the study developed a twelve-vignette matrix crossing three scenario families: pressure to send intimate images, threats to distribute previously shared images, and grooming-related secrecy and exclusivity. The present article reports a focused qualitative comparative analysis of three theoretically selected vignettes drawn from this matrix: subtle relational pressure to send an intimate image, explicit sextortion, and grooming through flattery and exclusivity. Model responses were analyzed using a descriptive coding rubric covering harm recognition, conceptual precision, moral clarity, responsibility attribution, developmental sensitivity, guidance quality, and actionability.
The findings from the three focal vignettes show strong convergence across models in scenarios involving explicit image-based sexual extortion and clear adult minor power asymmetries. In these cases, all systems recognized harm, attributed responsibility to the perpetrator, and avoided victim blaming. Greater variation emerged in more ambiguous scenarios involving emotional pressure, normative minimization, and subtle relational coercion. Although models often recognized manipulation, they differed in their use of precise harm terminology and in the specificity of their protective guidance.
The study contributes a relational and developmentally informed framework for evaluating AI responses to adolescent digital harm. It shows that the central challenge for youth facing AI systems may not be whether models can detect obvious abuse, but whether they can name, explain, and respond to coercion when harm is embedded in ordinary relationship language.
超越规则:对公共人工智能系统如何解释青少年数字场景中的性胁迫、隐私滥用和打扮进行重点比较分析
青少年越来越多地向对话式人工智能系统寻求有关亲密关系、性、隐私和网络冲突的信息、解释和建议。然而,目前的人工智能安全评估往往侧重于明确的内容违规和有害的输出,而较少关注道德上模糊的关系伤害形式,如强制性的性短信、性勒索和在线诱骗。这些伤害尤其难以识别,因为它们经常出现在普通的关系语言中,包括忠诚测试、情感压力、保密、奉承和伪装成亲密关系的威胁。本研究考察了四种可公开访问的对话式人工智能系统如何解释在明确性和关系模糊性方面各不相同的青少年数字伤害情景。利用通信隐私管理理论、关系伦理和对青少年数字脆弱性的研究,该研究开发了一个包含12个小插曲的矩阵,涵盖三种场景族:发送亲密图像的压力、分发先前共享图像的威胁,以及与修饰相关的保密和排他性。本文报告了从这个矩阵中选出的三个理论上的小插曲的集中定性比较分析:发送亲密图像的微妙关系压力,明确的性勒索,以及通过奉承和排他来修饰。采用描述性编码准则对模型反应进行分析,包括伤害识别、概念精度、道德清晰度、责任归因、发展敏感性、指导质量和可操作性。三个焦点小插曲的结果表明,在涉及明确的基于图像的性勒索和明确的成人轻微权力不对称的场景中,模型之间具有很强的收敛性。在这些情况下,所有系统都承认伤害,将责任归咎于肇事者,并避免指责受害者。更大的变化出现在更模糊的场景中,包括情绪压力、规范最小化和微妙的关系胁迫。虽然模型通常承认操纵,但它们在使用精确的伤害术语和保护性指导的特异性方面有所不同。该研究为评估人工智能对青少年数字伤害的反应提供了一个关系和发展知情框架。这表明,青少年面临的人工智能系统的核心挑战可能不是模型是否能够检测到明显的虐待,而是当伤害嵌入到普通关系语言中时,它们是否能够识别、解释和应对胁迫。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书