Lost in the comments: Social context as a single-pass jailbreak and defense on agentic platforms

IF 2 4区 计算机科学 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC
ETRI Journal Pub Date : 2026-10-20 Epub Date: 2026-10-09 DOI:10.4218/etrij.2026-0190
Taehyeon Yun, Seonhee Jeon, Geonwoo Kim, Jeongsu Park, Moohong Min
{"title":"Lost in the comments: Social context as a single-pass jailbreak and defense on agentic platforms","authors":"Taehyeon Yun,&nbsp;Seonhee Jeon,&nbsp;Geonwoo Kim,&nbsp;Jeongsu Park,&nbsp;Moohong Min","doi":"10.4218/etrij.2026-0190","DOIUrl":null,"url":null,"abstract":"<p>As LLM-based agents move onto multiagent platforms, they process direct prompts and surrounding social context—posts, comments, and upvotes—an attack surface that single-turn alignment never addressed. We built a simulation of Moltbook, a social network for AI agents, and a pipeline turning 100 JailBreakBench goals into platform-native posts with bystander comments of three valences: aggressive, ethical, and measured. Platform-context reformatting alone raises the attack success rate (ASR) of GPT-4o-mini from 7% to 71%, beating a twenty-query optimization baseline in one pass. Valence then acts as a bidirectional safety modulator: Ethical comments sharply suppress ASR, aggressive endorsements paradoxically reduce it by exposing intent, and measured, intellectually toned comments prove most dangerous, sustaining or elevating ASR. An ablation identifies valence rather than volume as key—a 35-fold rise in upvotes leaves ASR unchanged—and every finding reproduces under an independent safety classifier with human adjudication. Ambiguous social context thus poses a greater threat than explicit pressure, while safety-valenced signals offer a deployable defense for agentic platforms.</p>","PeriodicalId":11901,"journal":{"name":"ETRI Journal","volume":"48 5","pages":"796-806"},"PeriodicalIF":2.0000,"publicationDate":"2026-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.4218/etrij.2026-0190","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ETRI Journal","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.4218/etrij.2026-0190","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/10/9 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

As LLM-based agents move onto multiagent platforms, they process direct prompts and surrounding social context—posts, comments, and upvotes—an attack surface that single-turn alignment never addressed. We built a simulation of Moltbook, a social network for AI agents, and a pipeline turning 100 JailBreakBench goals into platform-native posts with bystander comments of three valences: aggressive, ethical, and measured. Platform-context reformatting alone raises the attack success rate (ASR) of GPT-4o-mini from 7% to 71%, beating a twenty-query optimization baseline in one pass. Valence then acts as a bidirectional safety modulator: Ethical comments sharply suppress ASR, aggressive endorsements paradoxically reduce it by exposing intent, and measured, intellectually toned comments prove most dangerous, sustaining or elevating ASR. An ablation identifies valence rather than volume as key—a 35-fold rise in upvotes leaves ASR unchanged—and every finding reproduces under an independent safety classifier with human adjudication. Ambiguous social context thus poses a greater threat than explicit pressure, while safety-valenced signals offer a deployable defense for agentic platforms.

在评论中迷失:社交环境是代理平台上的一次越狱和防御
当基于llm的代理迁移到多代理平台时,它们处理直接提示和周围的社会上下文——帖子、评论和支持——这是单轮调整无法解决的攻击面。我们建立了一个模拟Moltbook,一个人工智能代理的社交网络,以及一个将100个JailBreakBench目标转化为平台原生帖子的管道,旁观者的评论有三种价值:激进的,道德的和慎重的。仅平台上下文重新格式化就可以将gpt - 40 -mini的攻击成功率(ASR)从7%提高到71%,在一次通过中超过了20个查询优化基线。然后,效价充当双向安全调节器:道德评论急剧抑制ASR,激进的认可通过暴露意图而矛盾地减少ASR,而经过衡量的、理智的评论被证明是最危险的,维持或提高ASR。消融识别价而不是体积是关键——赞成数增加35倍使ASR保持不变——每一个发现都在一个独立的安全分类器下重现,并有人类裁决。因此,模糊的社会环境比明确的压力构成更大的威胁,而安全信号为代理平台提供了可部署的防御。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
ETRI Journal
ETRI Journal 工程技术-电信学
CiteScore
4.00
自引率
7.10%
发文量
98
审稿时长
6.9 months
期刊介绍: ETRI Journal is an international, peer-reviewed multidisciplinary journal published bimonthly in English. The main focus of the journal is to provide an open forum to exchange innovative ideas and technology in the fields of information, telecommunications, and electronics. Key topics of interest include high-performance computing, big data analytics, cloud computing, multimedia technology, communication networks and services, wireless communications and mobile computing, material and component technology, as well as security. With an international editorial committee and experts from around the world as reviewers, ETRI Journal publishes high-quality research papers on the latest and best developments from the global community.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书