The paradigm shift: A comprehensive survey on large vision language models for multimodal fake news detection

IF 17.5 1区 计算机科学 Q1 COMPUTER SCIENCE, INFORMATION SYSTEMS
Computer Science Review Pub Date : 2026-05-01 Epub Date: 2026-01-14 DOI:10.1016/j.cosrev.2026.100893
Wei Ai , Yilong Tan , Yuntao Shou , Tao Meng , Haowen Chen , Zhixiong He , Keqin Li
{"title":"The paradigm shift: A comprehensive survey on large vision language models for multimodal fake news detection","authors":"Wei Ai ,&nbsp;Yilong Tan ,&nbsp;Yuntao Shou ,&nbsp;Tao Meng ,&nbsp;Haowen Chen ,&nbsp;Zhixiong He ,&nbsp;Keqin Li","doi":"10.1016/j.cosrev.2026.100893","DOIUrl":null,"url":null,"abstract":"<div><div>In recent years, the rapid evolution of large vision–language models (LVLMs) has driven a paradigm shift in multimodal fake news detection (MFND), transforming it from traditional feature-engineering approaches to unified, end-to-end multimodal reasoning frameworks. Early methods primarily relied on shallow fusion techniques to capture correlations between text and images, but they struggled with high-level semantic understanding and complex cross-modal interactions. The emergence of LVLMs has fundamentally changed this landscape by enabling joint modeling of vision and language with powerful representation learning, thereby enhancing the ability to detect misinformation that leverages both textual narratives and visual content. Despite these advances, the field lacks a systematic survey that traces this transition and consolidates recent developments. To address this gap, this paper provides a comprehensive review of MFND through the lens of LVLMs. We first present a historical perspective, mapping the evolution from conventional multimodal detection pipelines to foundation model-driven paradigms. Next, we establish a structured taxonomy covering model architectures, datasets, and performance benchmarks. Furthermore, we analyze the remaining technical challenges, including interpretability, temporal reasoning, and domain generalization. Finally, we outline future research directions to guide the next stage of this paradigm shift. To the best of our knowledge, this is the first comprehensive survey to systematically document and analyze the transformative role of LVLMs in combating multimodal fake news. The summary of existing methods mentioned is in our Github: <span><span>https://github.com/Tan-YiLong/Overview-of-Fake-News-Detection</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":48633,"journal":{"name":"Computer Science Review","volume":"60 ","pages":"Article 100893"},"PeriodicalIF":17.5000,"publicationDate":"2026-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer Science Review","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S157401372600002X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/1/14 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years, the rapid evolution of large vision–language models (LVLMs) has driven a paradigm shift in multimodal fake news detection (MFND), transforming it from traditional feature-engineering approaches to unified, end-to-end multimodal reasoning frameworks. Early methods primarily relied on shallow fusion techniques to capture correlations between text and images, but they struggled with high-level semantic understanding and complex cross-modal interactions. The emergence of LVLMs has fundamentally changed this landscape by enabling joint modeling of vision and language with powerful representation learning, thereby enhancing the ability to detect misinformation that leverages both textual narratives and visual content. Despite these advances, the field lacks a systematic survey that traces this transition and consolidates recent developments. To address this gap, this paper provides a comprehensive review of MFND through the lens of LVLMs. We first present a historical perspective, mapping the evolution from conventional multimodal detection pipelines to foundation model-driven paradigms. Next, we establish a structured taxonomy covering model architectures, datasets, and performance benchmarks. Furthermore, we analyze the remaining technical challenges, including interpretability, temporal reasoning, and domain generalization. Finally, we outline future research directions to guide the next stage of this paradigm shift. To the best of our knowledge, this is the first comprehensive survey to systematically document and analyze the transformative role of LVLMs in combating multimodal fake news. The summary of existing methods mentioned is in our Github: https://github.com/Tan-YiLong/Overview-of-Fake-News-Detection.
范式转换:多模态假新闻检测大视觉语言模型的综合研究
近年来,大型视觉语言模型(LVLMs)的快速发展推动了多模态假新闻检测(MFND)的范式转变,将其从传统的特征工程方法转变为统一的端到端多模态推理框架。早期的方法主要依赖于浅层融合技术来捕获文本和图像之间的相关性,但它们在高级语义理解和复杂的跨模态交互方面遇到了困难。lvlm的出现从根本上改变了这一现状,它通过强大的表示学习实现了视觉和语言的联合建模,从而增强了检测错误信息的能力,同时利用文本叙述和视觉内容。尽管取得了这些进展,但该领域缺乏追踪这一转变并整合最近发展的系统调查。为了解决这一差距,本文通过LVLMs的视角对MFND进行了全面的回顾。我们首先提出了一个历史的观点,描绘了从传统的多模态检测管道到基础模型驱动范式的演变。接下来,我们建立一个涵盖模型体系结构、数据集和性能基准的结构化分类法。此外,我们分析了剩余的技术挑战,包括可解释性、时间推理和领域泛化。最后,我们概述了未来的研究方向,以指导这种范式转变的下一阶段。据我们所知,这是第一次系统地记录和分析lvlm在打击多模式假新闻方面的变革作用的综合调查。所提到的现有方法的总结在我们的Github中:https://github.com/Tan-YiLong/Overview-of-Fake-News-Detection。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computer Science Review
Computer Science Review Computer Science-General Computer Science
CiteScore
32.70
自引率
0.00%
发文量
26
审稿时长
51 days
期刊介绍: Computer Science Review, a publication dedicated to research surveys and expository overviews of open problems in computer science, targets a broad audience within the field seeking comprehensive insights into the latest developments. The journal welcomes articles from various fields as long as their content impacts the advancement of computer science. In particular, articles that review the application of well-known Computer Science methods to other areas are in scope only if these articles advance the fundamental understanding of those methods.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书