Evidence-borne prompt injection in LLM-assisted textual evidence triage

IF 3.1 4区 医学 Q3 COMPUTER SCIENCE, INFORMATION SYSTEMS
Dongho Kim, Damin Kim, Moohong Min
{"title":"Evidence-borne prompt injection in LLM-assisted textual evidence triage","authors":"Dongho Kim,&nbsp;Damin Kim,&nbsp;Moohong Min","doi":"10.1016/j.fsidi.2026.302187","DOIUrl":null,"url":null,"abstract":"<div><div>Large language models (LLMs) are increasingly used to support forensic triage and classification over natural-language evidence such as emails, SMS messages, and notes. This study presents a controlled first measurement of a new attack surface in LLM-assisted evidence triage, in which the evidence being analyzed can itself contain natural-language instructions that steer the model's forensic judgment. We define this threat as evidence-borne prompt injection, a form of indirect prompt injection in which the injection is delivered through the evidence itself, and characterize it as an interpretation-layer anti-forensic attack surface in LLM-assisted textual evidence triage. To evaluate this threat, we construct a controlled synthetic benchmark of 300 clean messaging evidence items and 9000 injection-augmented variants. The analyzer performs structured forensic triage over suspicion label, risk level, and issue type. Our results show that the GPT-4o-based analyzer achieves near-perfect suspicion-label accuracy on the clean benchmark, but outputs the attacker-targeted suspicion label in 31.3% of injected cases. The attack is highly asymmetric. False-positive injection from normal to suspicious evidence succeeds in 54.1% of cases, whereas evasion from suspicious to normal succeeds in 8.5%. We also show that a simple black-box prompt defense that treats evidence as untrusted data reduces attack success rate (ASR) from 31.3% to 0.6% without degrading clean suspicion-label accuracy. These findings show that textual evidence in LLM-assisted forensic pipelines is not only an object of analysis, but also a potential instruction carrier that can distort forensic triage outcomes.</div></div>","PeriodicalId":48481,"journal":{"name":"Forensic Science International-Digital Investigation","volume":"58 ","pages":"Article 302187"},"PeriodicalIF":3.1000,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Forensic Science International-Digital Investigation","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666281726001447","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/10/10 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Large language models (LLMs) are increasingly used to support forensic triage and classification over natural-language evidence such as emails, SMS messages, and notes. This study presents a controlled first measurement of a new attack surface in LLM-assisted evidence triage, in which the evidence being analyzed can itself contain natural-language instructions that steer the model's forensic judgment. We define this threat as evidence-borne prompt injection, a form of indirect prompt injection in which the injection is delivered through the evidence itself, and characterize it as an interpretation-layer anti-forensic attack surface in LLM-assisted textual evidence triage. To evaluate this threat, we construct a controlled synthetic benchmark of 300 clean messaging evidence items and 9000 injection-augmented variants. The analyzer performs structured forensic triage over suspicion label, risk level, and issue type. Our results show that the GPT-4o-based analyzer achieves near-perfect suspicion-label accuracy on the clean benchmark, but outputs the attacker-targeted suspicion label in 31.3% of injected cases. The attack is highly asymmetric. False-positive injection from normal to suspicious evidence succeeds in 54.1% of cases, whereas evasion from suspicious to normal succeeds in 8.5%. We also show that a simple black-box prompt defense that treats evidence as untrusted data reduces attack success rate (ASR) from 31.3% to 0.6% without degrading clean suspicion-label accuracy. These findings show that textual evidence in LLM-assisted forensic pipelines is not only an object of analysis, but also a potential instruction carrier that can distort forensic triage outcomes.
法学硕士辅助文本证据分诊中的循证提示注射
大型语言模型(llm)越来越多地用于支持对自然语言证据(如电子邮件、SMS消息和笔记)的鉴定分类。本研究提出了在法学硕士辅助证据分类中对新攻击面进行控制的第一次测量,其中被分析的证据本身可以包含引导模型法医判断的自然语言指令。我们将这种威胁定义为基于证据的提示注入,这是一种间接提示注入的形式,其中注入通过证据本身传递,并将其描述为llm辅助文本证据分类中的解释层反取证攻击面。为了评估这种威胁,我们构建了一个由300个干净的消息传递证据项和9000个注入增强变体组成的受控综合基准。分析器根据怀疑标签、风险级别和问题类型执行结构化的取证分类。我们的研究结果表明,基于gpt -4的分析仪在清洁基准上实现了近乎完美的怀疑标签准确性,但在31.3%的注射案例中输出了针对攻击者的怀疑标签。这种攻击是高度不对称的。从正常证据到可疑证据的假阳性注射成功率为54.1%,而从可疑证据到正常证据的逃避成功率为8.5%。我们还表明,将证据视为不可信数据的简单黑箱提示防御将攻击成功率(ASR)从31.3%降低到0.6%,而不会降低干净怀疑标签的准确性。这些发现表明,法学硕士辅助法医管道中的文本证据不仅是分析的对象,而且是可能扭曲法医分类结果的潜在指令载体。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
5.90
自引率
15.00%
发文量
87
审稿时长
76 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书