Taehyeon Yun, Seonhee Jeon, Geonwoo Kim, Jeongsu Park, Moohong Min
{"title":"Lost in the comments: Social context as a single-pass jailbreak and defense on agentic platforms","authors":"Taehyeon Yun, Seonhee Jeon, Geonwoo Kim, Jeongsu Park, Moohong Min","doi":"10.4218/etrij.2026-0190","DOIUrl":null,"url":null,"abstract":"<p>As LLM-based agents move onto multiagent platforms, they process direct prompts and surrounding social context—posts, comments, and upvotes—an attack surface that single-turn alignment never addressed. We built a simulation of Moltbook, a social network for AI agents, and a pipeline turning 100 JailBreakBench goals into platform-native posts with bystander comments of three valences: aggressive, ethical, and measured. Platform-context reformatting alone raises the attack success rate (ASR) of GPT-4o-mini from 7% to 71%, beating a twenty-query optimization baseline in one pass. Valence then acts as a bidirectional safety modulator: Ethical comments sharply suppress ASR, aggressive endorsements paradoxically reduce it by exposing intent, and measured, intellectually toned comments prove most dangerous, sustaining or elevating ASR. An ablation identifies valence rather than volume as key—a 35-fold rise in upvotes leaves ASR unchanged—and every finding reproduces under an independent safety classifier with human adjudication. Ambiguous social context thus poses a greater threat than explicit pressure, while safety-valenced signals offer a deployable defense for agentic platforms.</p>","PeriodicalId":11901,"journal":{"name":"ETRI Journal","volume":"48 5","pages":"796-806"},"PeriodicalIF":2.0000,"publicationDate":"2026-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.4218/etrij.2026-0190","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ETRI Journal","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.4218/etrij.2026-0190","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/10/9 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
As LLM-based agents move onto multiagent platforms, they process direct prompts and surrounding social context—posts, comments, and upvotes—an attack surface that single-turn alignment never addressed. We built a simulation of Moltbook, a social network for AI agents, and a pipeline turning 100 JailBreakBench goals into platform-native posts with bystander comments of three valences: aggressive, ethical, and measured. Platform-context reformatting alone raises the attack success rate (ASR) of GPT-4o-mini from 7% to 71%, beating a twenty-query optimization baseline in one pass. Valence then acts as a bidirectional safety modulator: Ethical comments sharply suppress ASR, aggressive endorsements paradoxically reduce it by exposing intent, and measured, intellectually toned comments prove most dangerous, sustaining or elevating ASR. An ablation identifies valence rather than volume as key—a 35-fold rise in upvotes leaves ASR unchanged—and every finding reproduces under an independent safety classifier with human adjudication. Ambiguous social context thus poses a greater threat than explicit pressure, while safety-valenced signals offer a deployable defense for agentic platforms.
期刊介绍:
ETRI Journal is an international, peer-reviewed multidisciplinary journal published bimonthly in English. The main focus of the journal is to provide an open forum to exchange innovative ideas and technology in the fields of information, telecommunications, and electronics.
Key topics of interest include high-performance computing, big data analytics, cloud computing, multimedia technology, communication networks and services, wireless communications and mobile computing, material and component technology, as well as security.
With an international editorial committee and experts from around the world as reviewers, ETRI Journal publishes high-quality research papers on the latest and best developments from the global community.