{"title":"How Large Language Models Weight Narrative Cues When Detecting Deception in Oral Accounts: A Multi-Model Comparison","authors":"Meng-Chen He, Wei Ji, Jing-Xuan Ran, Jia-Xin Cui, Wen-Jing Yan, Jing Liang","doi":"10.1002/acp.70297","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Lie detection research has increasingly turned to artificial intelligence, yet the application of large language models (LLMs) remains underexplored for transcribed oral narratives. We compared five LLMs (Gemini-3-flash, Gemini-3-pro, Deepseek-v4-flash, GPT-5.6-luna, and Grok-4) in classifying truthful and deceptive statements from interview transcripts of oral travel narratives collected from 95 Chinese-speaking participants. Guided by Criteria-Based Content Analysis (CBCA), Reality Monitoring (RM), and the Verifiability Approach (VA), theory-driven prompts instructed models to score five narrative cues before making binary veracity judgments. Gemini-3-flash achieved the highest accuracy (74.74%, AUC = 0.76) with 81.63% sensitivity and 67.39% specificity, and stable repeated-run performance. For this optimal model, unusual/superfluous details served as the sole significant predictor of objective veracity even after controlling for text length. LLMs can detect deception above chance but show large performance heterogeneity. Independent human coding, cross-cultural replications, and adversarial robustness testing are needed before real-world deployment.</p>\n </div>","PeriodicalId":48281,"journal":{"name":"Applied Cognitive Psychology","volume":"40 6","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2026-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Cognitive Psychology","FirstCategoryId":"102","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/acp.70297","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
Abstract
Lie detection research has increasingly turned to artificial intelligence, yet the application of large language models (LLMs) remains underexplored for transcribed oral narratives. We compared five LLMs (Gemini-3-flash, Gemini-3-pro, Deepseek-v4-flash, GPT-5.6-luna, and Grok-4) in classifying truthful and deceptive statements from interview transcripts of oral travel narratives collected from 95 Chinese-speaking participants. Guided by Criteria-Based Content Analysis (CBCA), Reality Monitoring (RM), and the Verifiability Approach (VA), theory-driven prompts instructed models to score five narrative cues before making binary veracity judgments. Gemini-3-flash achieved the highest accuracy (74.74%, AUC = 0.76) with 81.63% sensitivity and 67.39% specificity, and stable repeated-run performance. For this optimal model, unusual/superfluous details served as the sole significant predictor of objective veracity even after controlling for text length. LLMs can detect deception above chance but show large performance heterogeneity. Independent human coding, cross-cultural replications, and adversarial robustness testing are needed before real-world deployment.
期刊介绍:
Applied Cognitive Psychology seeks to publish the best papers dealing with psychological analyses of memory, learning, thinking, problem solving, language, and consciousness as they occur in the real world. Applied Cognitive Psychology will publish papers on a wide variety of issues and from diverse theoretical perspectives. The journal focuses on studies of human performance and basic cognitive skills in everyday environments including, but not restricted to, studies of eyewitness memory, autobiographical memory, spatial cognition, skill training, expertise and skilled behaviour. Articles will normally combine realistic investigations of real world events with appropriate theoretical analyses and proper appraisal of practical implications.